00000001:02000400:2.0F:1788329814.897772:0:2957:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788329835.997270:0:3189:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1788329838.051146:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 495 MB/s 00000001:01000000:2.0:1788329838.302143:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 523 MB/s 00000001:01000000:2.0:1788329838.552112:0:3250:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4303 MB/s 00000020:02000000:3.0:1788329839.449283:0:3281:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g6cc0f2c 00000400:02000000:2.0:1788329840.866647:0:3296:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.147@tcp [8/256/0/180] 00008000:02000000:0.0:1788329844.924893:0:3446:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788329907.025867:0:5251:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788329919.955037:0:5825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788329919.955046:0:5825:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788329919.955194:0:5825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000009618bcf4 00000080:02000400:2.0:1788329919.955209:0:5825:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788329919.963615:0:5825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788329919.963632:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788329919.963681:0:5825:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000000ce534bc) 00000020:00000080:2.0:1788329919.963716:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0F:1788329920.004813:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788329920.005224:0:5825:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788329920.043409:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788329920.043453:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788329920.043478:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788329920.047900:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788329920.047971:0:5825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788329920.048566:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788329920.048576:0:5825:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788329920.048591:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa4af 00000020:01000004:2.0:1788329920.048600:0:5825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788329920.048605:0:5825:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788329920.048612:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009618bcf4 from MGS 00000020:01000004:2.0:1788329920.048619:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788329920.048632:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000067648e2c) 00000020:00000080:2.0:1788329920.048643:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788329920.052727:0:5825:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009618bcf4 from MGS, refs=2 00080000:01000000:3.0:1788329920.055659:0:5825:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788329920.055688:0:5825:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa4bd 00000100:00100000:3.0:1788329920.056002:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788329920.056199:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788329920.056208:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788329920.057319:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788329920.057329:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788329920.058200:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788329920.058428:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788329920.058434:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788329920.061284:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788329920.061315:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788329920.061952:0:5825:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788329920.061967:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788329920.066277:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329920.066285:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329920.066287:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329920.075112:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329920.075128:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329920.075133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329920.077111:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788329920.086697:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1788329920.326624:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1855 MB/s 00000001:01000000:3.0:1788329920.577206:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2895 MB/s 00000001:01000000:0.0:1788329920.831163:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 649 MB/s 00000001:01000000:2.0:1788329921.081665:0:5825:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 414 MB/s 00080000:10000000:2.0:1788329921.098615:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1788329921.121825:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788329921.123612:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788329921.123635:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788329921.123638:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788329921.127345:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788329921.131385:0:5825:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788329921.131447:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788329921.131788:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788329921.131819:0:5825:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788329921.132267:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788329921.132482:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788329921.132502:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788329921.136854:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788329921.136890:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788329921.137500:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788329921.137508:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788329921.140271:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788329921.140300:0:5825:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.147@tcp' 00000020:01000004:3.0:1788329921.140302:0:5825:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788329921.140459:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.147@tcp (typ=mgc) 00000020:00000080:3.0:1788329921.140483:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.147@tcp (000000001e2d13ec) 00000020:00000080:3.0:1788329921.140506:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788329921.140711:0:5825:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000929ed742@MGC192.168.202.147@tcp: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788329921.140891:0:5825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.147@tcp-0 is initialized 00000040:01000000:3.0:1788329921.140906:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788329921.148970:0:5840:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788329921.149724:0:5841:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788329921.150109:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.147@tcp (uuid c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6) 00000020:00000080:0.0:1788329921.150142:0:5825:0:(genops.c:1385:class_connect()) connect: client c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6, cookie 0x91094de4de9aa4cb 00000100:00080000:0.0:1788329921.150159:0:5825:0:(import.c:510:import_select_connection()) MGC192.168.202.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329921.150167:0:5825:0:(import.c:624:import_select_connection()) MGC192.168.202.147@tcp: import 00000000929ed742 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:0.0:1788329921.150325:0:5825:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000966b76cf x1875199750307968/t0(0) o250->MGC192.168.202.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329921.150356:0:5825:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6->MGS 00000020:01000004:0.0:1788329921.150377:0:5825:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788329921.150399:0:5825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788329921.150464:0:5825:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000bc1cd45f) 00000020:00000080:0.0:1788329921.150481:0:5825:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788329921.150959:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000966b76cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3311:1875199750307968:0@lo:250: 00000100:00100000:2.0:1788329921.151095:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329921.151713:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750307968 00000100:00100000:2.0:1788329921.151723:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750307968 00000100:00100000:2.0:1788329921.151757:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329921.151764:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054298d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875199750307968:12345-0@lo:250: 00010000:00080000:2.0:1788329921.151790:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1788329921.151815:0:5837:0:(genops.c:1385:class_connect()) connect: client c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6, cookie 0x91094de4de9aa4d9 00000100:00080000:2.0:1788329921.151943:0:5837:0:(import.c:65:import_set_state_nolock()) 000000001f350935 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788329921.152022:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054298d9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:3311:x1875199750307968:12345-0@lo:250: Request processed in 257us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329921.152028:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329921.152083:0:3311:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788329921.152092:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.147@tcp: connect to target with instance 0 00000100:00080000:2.0:1788329921.152105:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788329921.152110:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788329921.152113:0:3311:0:(import.c:65:import_set_state_nolock()) 00000000929ed742 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788329921.152115:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788329921.152128:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788329921.152132:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000966b76cf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3311:1875199750307968:0@lo:250: 00000100:00100000:0.0:1788329921.192774:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788329921.194034:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788329921.194044:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788329921.196499:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788329921.196541:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788329921.197474:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788329921.197485:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788329921.198379:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788329921.198654:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788329921.198660:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788329921.204357:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788329921.204374:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788329921.313453:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788329921.314422:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788329921.314432:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788329921.322115:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788329921.322147:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788329921.324189:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788329921.324414:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788329921.324420:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788329921.333844:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788329921.333877:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788329921.336300:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329921.341200:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788329921.341221:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788329921.343060:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788329921.343075:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788329921.348292:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329921.349158:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788329921.349166:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788329921.352421:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788329921.352436:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788329921.398586:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788329921.398833:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788329921.398840:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788329921.409709:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788329921.409737:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788329921.422737:0:5825:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788329921.422765:0:5825:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788329921.427122:0:5825:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788329921.427160:0:5825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788329921.427168:0:5825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788329921.427342:0:5825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788329921.427390:0:5825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.147@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788329921.427395:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788329921.427397:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329921.427399:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329921.427400:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329921.427402:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329921.427403:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329921.427404:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329921.427406:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329921.427407:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329921.427409:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329921.427410:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329921.427414:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788329921.427417:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788329921.427419:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788329921.427420:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329921.427421:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329921.427422:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788329921.427424:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329921.427424:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329921.427425:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329921.427426:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329921.427428:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788329921.427429:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788329921.427429:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329921.427431:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788329921.427486:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788329921.427552:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1b1199b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308096:0@lo:253: 00000100:00100000:2.0:1788329921.427670:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329921.427757:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000efb80e46 going to sleep for 11 seconds 00000100:00100000:3.0:1788329921.428062:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308096 00000100:00100000:3.0:1788329921.428075:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308096 00000100:00100000:3.0:1788329921.428150:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329921.428161:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052377968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:5825:x1875199750308096:12345-0@lo:253: 20000000:01000000:3.0:1788329921.428213:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788329921.428216:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1788329921.438824:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788329921.439139:0:5839:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788329921.439506:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788329921.442210:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788329921.443017:0:5839:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788329921.443024:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788329921.443052:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788329921.443057:0:5839:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788329921.443081:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788329921.443452:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329921.443936:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788329921.443952:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788329921.444004:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788329921.444057:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788329921.444094:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788329921.444194:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788329921.444203:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788329921.444245:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788329921.444253:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788329921.444284:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788329921.444292:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788329921.444341:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788329921.444405:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788329921.444438:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788329921.444444:0:5839:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788329921.444457:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329921.447063:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788329921.447100:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788329921.447183:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788329921.447221:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788329921.447272:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788329921.447290:0:5839:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788329921.447408:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788329921.447416:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788329921.447464:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788329921.447502:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788329921.449038:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788329921.449068:0:5839:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788329921.449240:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788329921.449252:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788329921.449287:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788329921.449324:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788329921.449509:0:5839:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788329921.452131:0:5839:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788329921.452146:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788329921.452915:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788329921.453402:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788329921.453436:0:5839:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.147@tcp for mdt 20000000:01000000:0.0:1788329921.453438:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.147@tcp (null) (null) (null) 00000040:00080000:0.0:1788329921.453476:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788329921.453484:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788329921.453511:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1788329921.456081:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.147@tcp (null) (null) 00000040:00080000:0.0:1788329921.456299:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1788329921.456315:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1788329921.456346:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1788329921.456377:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1788329921.456641:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788329921.456647:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788329921.456653:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788329921.456668:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788329921.456671:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788329921.456715:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788329921.456718:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788329921.457686:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:0.0:1788329921.458498:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1788329921.458592:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:0.0:1788329921.458673:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:0.0:1788329921.458688:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788329921.458700:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788329921.459229:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788329921.459699:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788329921.459762:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788329921.459797:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788329921.459811:0:5839:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788329921.459814:0:5839:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788329921.459820:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788329921.459823:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788329921.459830:0:5839:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788329921.459840:0:5839:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788329921.464375:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788329921.464780:0:5839:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788329921.480407:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788329921.480473:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788329921.480962:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788329921.480990:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788329921.481016:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481033:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481044:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481050:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481056:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481063:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481080:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000b960291 already unused, calling callback (0000000068b72da7) 00010000:00010000:0.0:1788329921.481085:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481093:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481108:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481116:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.481121:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b960291/0x91094de4de9aa4e0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788329921.481143:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788329921.950164:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052377968 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:5825:x1875199750308096:12345-0@lo:253: Request processed in 521986us (522476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329921.950206:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329921.950363:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1b1199b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308096:0@lo:253: 10000000:01000000:2.0:1788329921.950396:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788329921.950400:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788329921.950402:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788329921.950404:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788329921.950405:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788329921.950406:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788329921.950408:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788329921.950410:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788329921.950411:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788329921.950413:0:5825:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788329921.950415:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788329921.950416:0:5825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788329921.950454:0:5825:0:(tgt_mount.c:101:server_register_mount()) register mount 000000009618bcf4 from lustre-MDT0000 10000000:01000000:2.0:1788329921.950511:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788329921.950514:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788329921.950560:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9546b4ba4d28 10000000:01000000:2.0:1788329921.950566:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788329921.950575:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9546b4ba4d28 from 1 10000000:01000000:2.0:1788329921.950579:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788329921.950633:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.950650:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.950661:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329921.950697:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e1b1199b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308224:0@lo:101: 00000100:00100000:2.0:1788329921.950768:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329921.950850:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000285a4e59 going to sleep for 11 seconds 00000100:00100000:0.0:1788329921.950955:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308224 00000100:00100000:0.0:1788329921.950965:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308224 00000100:00100000:0.0:1788329921.951030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788329921.951041:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c61abd32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:5825:x1875199750308224:12345-0@lo:101: 00010000:00010000:0.0:1788329921.951059:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329921.951079:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa4e7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.951113:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.951125:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329921.951144:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b960291, rc 0) 00000100:00100000:0.0:1788329921.951213:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c61abd32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:5825:x1875199750308224:12345-0@lo:101: Request processed in 173us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329921.951220:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788329921.951427:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e1b1199b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308224:0@lo:101: 00010000:00010000:1.0:1788329921.951445:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.951466:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329921.951599:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308352:0@lo:501: 00000100:00100000:1.0:1788329921.951646:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329921.951679:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000680c54c6 going to sleep for 11 seconds 00000100:00100000:0.0:1788329921.951779:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308352 00000100:00100000:0.0:1788329921.951784:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308352 00000100:00100000:0.0:1788329921.951823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788329921.951831:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004c085538 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:5825:x1875199750308352:12345-0@lo:501: 00000100:00100000:0.0:1788329921.952254:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004c085538 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:5825:x1875199750308352:12345-0@lo:501: Request processed in 418us (602us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788329921.952266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788329921.952618:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308352:0@lo:501: 10000000:01000000:1.0:1788329921.952652:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788329921.952674:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.952706:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329921.952717:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff954689604000 10000000:01000000:1.0:1788329921.952721:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788329921.952726:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff954689604000 10000000:01000000:1.0:1788329921.952729:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788329921.952731:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff954689604000 from 1 10000000:01000000:1.0:1788329921.952734:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788329921.952772:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.952779:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.952788:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329921.952806:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308480:0@lo:101: 00000100:00100000:1.0:1788329921.952841:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329921.952881:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000680c54c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788329921.952953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308480 00000100:00100000:2.0:1788329921.952960:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308480 00000100:00100000:2.0:1788329921.953011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329921.953022:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000404690ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:5825:x1875199750308480:12345-0@lo:101: 00010000:00010000:2.0:1788329921.953035:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329921.953054:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005b86f44b/0x91094de4de9aa4fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa4f5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.953079:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005b86f44b/0x91094de4de9aa4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa4f5 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.953091:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005b86f44b/0x91094de4de9aa4fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa4f5 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.953101:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005b86f44b, rc 0) 00000100:00100000:2.0:1788329921.953137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000404690ab pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+7:5825:x1875199750308480:12345-0@lo:101: Request processed in 116us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329921.953144:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788329921.953286:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308480:0@lo:101: 00010000:00010000:1.0:1788329921.953298:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.953307:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329921.953335:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788329921.953347:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.953354:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 000000002d0a0161/0x91094de4de9aa4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329921.953360:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788329921.953364:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788329921.953368:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff954689604000 10000000:01000000:1.0:1788329921.953371:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788329921.953373:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788329921.953375:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788329921.953399:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.953405:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.953412:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329921.953424:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308608:0@lo:101: 00000100:00100000:1.0:1788329921.953451:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329921.953695:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000680c54c6 going to sleep for 11 seconds 00000100:00100000:2.0:1788329921.953788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308608 00000100:00100000:2.0:1788329921.953794:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308608 00000100:00100000:2.0:1788329921.953833:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329921.953841:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd8fd5ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+7:5825:x1875199750308608:12345-0@lo:101: 00010000:00010000:2.0:1788329921.953851:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329921.953862:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa503 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.953881:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa503 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.953899:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa503 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329921.953906:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010b0f4ef, rc 0) 00000100:00100000:2.0:1788329921.953946:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd8fd5ca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+8:5825:x1875199750308608:12345-0@lo:101: Request processed in 105us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329921.953952:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788329921.954064:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308608:0@lo:101: 00010000:00010000:1.0:1788329921.954077:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329921.954096:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329921.954149:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308736:0@lo:501: 00000100:00100000:1.0:1788329921.954178:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329921.954202:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000680c54c6 going to sleep for 11 seconds 00000100:00100000:0.0:1788329921.954259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308736 00000100:00100000:0.0:1788329921.954267:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308736 00000100:00100000:0.0:1788329921.954307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788329921.954314:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006adce6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+8:5825:x1875199750308736:12345-0@lo:501: 00000100:00100000:0.0:1788329921.954828:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006adce6d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5825:x1875199750308736:12345-0@lo:501: Request processed in 512us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329921.954836:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788329921.955064:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308736:0@lo:501: 00000100:00100000:1.0:1788329921.955109:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308864:0@lo:503: 00000100:00100000:1.0:1788329921.955156:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329921.955198:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000680c54c6 going to sleep for 11 seconds 00000100:00100000:0.0:1788329921.955256:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308864 00000100:00100000:0.0:1788329921.955262:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308864 00000100:00100000:0.0:1788329921.955299:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788329921.955306:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000608738be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5825:x1875199750308864:12345-0@lo:503: 00000100:00100000:0.0:1788329921.955816:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000608738be pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5825:x1875199750308864:12345-0@lo:503: Request processed in 508us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329921.955826:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788329921.955991:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750308864:0@lo:503: 00000100:00100000:3.0:1788329921.956837:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a680ee0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5867:1875199750308992:0@lo:502: 00000100:00100000:3.0:1788329921.956912:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329921.957003:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be65657 going to sleep for 11 seconds 00000100:00100000:2.0:1788329921.957050:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750308992 00000100:00100000:2.0:1788329921.957059:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750308992 00000100:00100000:2.0:1788329921.957151:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788329921.957161:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c84e2a30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5867:x1875199750308992:12345-0@lo:502: 00000100:00100000:2.0:1788329921.957773:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c84e2a30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5867:x1875199750308992:12345-0@lo:502: Request processed in 295us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329921.957786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788329921.957912:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a680ee0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5867:1875199750308992:0@lo:502: 00000020:01000000:3.0:1788329921.957945:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329921.957969:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329921.957972:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788329921.957978:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788329921.957982:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788329921.958007:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000051e7fd95) 00000020:00000080:3.0:1788329921.958037:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788329921.958044:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788329921.958157:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788329921.958164:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa518 00000020:00000080:3.0:1788329921.958479:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788329921.958484:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329921.958488:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329921.958490:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788329921.958492:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329921.958495:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329921.958496:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788329921.958499:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788329921.958507:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d03112df) 00000020:00000080:3.0:1788329921.958542:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788329921.958547:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788329921.958549:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788329921.958552:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788329921.958560:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788329921.958609:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009618bcf4 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788329921.958625:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000031919937) 00000020:00000080:3.0:1788329921.958632:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788329921.958707:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788329921.958713:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9aa52d 00000020:00000080:3.0:1788329921.958818:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788329921.958824:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788329921.958829:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x91094de4de9aa534 00080000:01000000:3.0:1788329921.958833:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788329921.958837:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa53b 00080000:10000000:3.0:1788329921.959339:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788329921.959639:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788329921.967047:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788329922.039716:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788329922.040514:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788329922.043292:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788329922.043972:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788329922.089391:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fa25865a) 00000020:00000080:0.0:1788329922.089439:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788329922.089571:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788329922.089580:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa549 00000020:00000080:3.0:1788329922.092189:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788329922.096337:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788329922.142762:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1788329922.161668:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788329922.205258:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329922.241805:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329922.307819:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788329922.346799:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1788329922.386985:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x91094de4de9aa550 00000020:00000080:3.0:1788329922.387397:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788329922.387411:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329922.387418:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329922.387421:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788329922.387424:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329922.387428:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329922.387429:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788329922.387432:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788329922.387433:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788329922.387436:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329922.387438:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329922.387439:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788329922.387441:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329922.387445:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329922.387446:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788329922.387450:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788329922.387492:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788329922.387583:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a680ee0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5867:1875199750309120:0@lo:502: 00000100:00100000:3.0:1788329922.387692:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329922.387751:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000000be65657 going to sleep for 11 seconds 00000100:00100000:3.0:1788329922.387781:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309120 00000100:00100000:3.0:1788329922.387790:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309120 00000100:00100000:3.0:1788329922.387838:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788329922.387846:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000640e26cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5867:x1875199750309120:12345-0@lo:502: 00000100:00100000:3.0:1788329922.388179:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000640e26cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5867:x1875199750309120:12345-0@lo:502: Request processed in 332us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329922.388187:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788329922.388247:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a680ee0a pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5867:1875199750309120:0@lo:502: 00000020:01000000:3.0:1788329922.388275:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329922.388280:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329922.388281:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1788329922.388285:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788329922.389727:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788329922.389766:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788329922.389836:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.389852:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329922.389928:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954689604000 from 1 10000000:01000000:1.0:1788329922.389932:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788329922.389991:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.389998:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.390032:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329922.390061:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309248:0@lo:101: 00000100:00100000:1.0:1788329922.390142:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329922.390191:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f989dc78 going to sleep for 11 seconds 00000100:00100000:2.0:1788329922.390271:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309248 00000100:00100000:2.0:1788329922.390281:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309248 00000100:00100000:2.0:1788329922.390333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788329922.390341:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ecf8367b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:5825:x1875199750309248:12345-0@lo:101: 00010000:00010000:2.0:1788329922.390356:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329922.390370:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa557 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.390468:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa557 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.390481:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa557 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.390502:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f93c7f56, rc 0) 00000100:00100000:2.0:1788329922.390631:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ecf8367b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:5825:x1875199750309248:12345-0@lo:101: Request processed in 290us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329922.390638:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788329922.390843:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309248:0@lo:101: 00010000:00010000:1.0:1788329922.390931:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.390942:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329922.391730:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309376:0@lo:256: 00000100:00100000:1.0:1788329922.391798:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329922.391843:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f989dc78 going to sleep for 11 seconds 00000100:00100000:0.0:1788329922.391998:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309376 00000100:00100000:0.0:1788329922.392007:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309376 00000100:00100000:0.0:1788329922.392058:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788329922.392068:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8eea4e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:5825:x1875199750309376:12345-0@lo:256: 20000000:01000000:0.0:1788329922.392096:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788329922.392105:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788329922.392200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8eea4e7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:5825:x1875199750309376:12345-0@lo:256: Request processed in 133us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329922.392208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788329922.392345:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309376:0@lo:256: 10000000:01000000:1.0:1788329922.393164:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788329922.393196:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.393212:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329922.393222:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954689604000 from 1 10000000:01000000:1.0:1788329922.393225:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788329922.393288:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.393296:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.393307:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329922.393325:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309504:0@lo:101: 00000100:00100000:1.0:1788329922.393456:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329922.393739:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f989dc78 going to sleep for 11 seconds 00000100:00100000:2.0:1788329922.393990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309504 00000100:00100000:2.0:1788329922.394001:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309504 00000100:00100000:0.0:1788329922.394195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788329922.394209:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000496e0260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:5825:x1875199750309504:12345-0@lo:101: 00010000:00010000:0.0:1788329922.394233:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329922.394261:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa565 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329922.394295:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa565 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329922.394329:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa565 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329922.394339:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091a7ca60, rc 0) 00000100:00100000:0.0:1788329922.394494:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000496e0260 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750309504:12345-0@lo:101: Request processed in 287us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329922.394501:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788329922.394650:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002e95805f pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309504:0@lo:101: 00010000:00010000:2.0:1788329922.394672:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.394692:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329922.394772:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309632:0@lo:501: 00000100:00100000:2.0:1788329922.394809:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329922.395098:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edc78197 going to sleep for 11 seconds 00000100:00100000:1.0:1788329922.395184:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309632 00000100:00100000:1.0:1788329922.395190:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309632 00000100:00100000:1.0:1788329922.395238:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788329922.395246:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f640a0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750309632:12345-0@lo:501: 00000100:00100000:1.0:1788329922.396314:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f640a0f0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750309632:12345-0@lo:501: Request processed in 1064us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329922.396328:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788329922.396821:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309632:0@lo:501: 00000100:00100000:2.0:1788329922.396971:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309760:0@lo:503: 00000100:00100000:2.0:1788329922.397035:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329922.397082:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edc78197 going to sleep for 11 seconds 00000100:00100000:1.0:1788329922.397159:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309760 00000100:00100000:1.0:1788329922.397168:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309760 00000100:00100000:1.0:1788329922.397282:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788329922.397293:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002169a44d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750309760:12345-0@lo:503: 00000040:00080000:1.0:1788329922.397359:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788329922.397502:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002169a44d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750309760:12345-0@lo:503: Request processed in 211us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329922.397510:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788329922.397623:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309760:0@lo:503: 00000040:00080000:1.0:1788329922.402470:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788329922.404947:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788329922.404999:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788329922.405139:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.405187:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329922.405263:0:5825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788329922.405266:0:5825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff954689604000 10000000:01000000:2.0:1788329922.405269:0:5825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff954689604000 10000000:01000000:2.0:1788329922.405274:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788329922.405282:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954689604000 from 1 10000000:01000000:2.0:1788329922.405284:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788329922.405342:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.405350:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.405365:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329922.405464:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309888:0@lo:101: 00000100:00100000:2.0:1788329922.405604:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329922.405661:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001d75358 going to sleep for 11 seconds 00000100:00100000:3.0:1788329922.405776:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750309888 00000100:00100000:3.0:1788329922.405788:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750309888 00000100:00100000:3.0:1788329922.405845:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788329922.405854:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000ea67dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750309888:12345-0@lo:101: 00010000:00010000:3.0:1788329922.405943:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329922.405961:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa573 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.405989:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa573 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.406001:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa573 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.406012:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d21ceb7, rc 0) 00000100:00100000:3.0:1788329922.406059:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000ea67dbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5825:x1875199750309888:12345-0@lo:101: Request processed in 206us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329922.406066:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788329922.406169:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750309888:0@lo:101: 00010000:00010000:2.0:1788329922.406186:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329922.406195:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329922.406276:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750310016:0@lo:501: 00000100:00100000:2.0:1788329922.406301:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329922.406329:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001d75358 going to sleep for 11 seconds 00000100:00100000:3.0:1788329922.406452:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310016 00000100:00100000:3.0:1788329922.406458:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310016 00000100:00100000:3.0:1788329922.406496:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788329922.406502:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e5e8e622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5825:x1875199750310016:12345-0@lo:501: 00000100:00100000:3.0:1788329922.406939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e5e8e622 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5825:x1875199750310016:12345-0@lo:501: Request processed in 437us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329922.406948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788329922.407027:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750310016:0@lo:501: 00000100:00100000:2.0:1788329922.407061:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750310144:0@lo:503: 00000100:00100000:2.0:1788329922.407104:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329922.407132:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 0000000001d75358 going to sleep for 11 seconds 00000100:00100000:2.0:1788329922.407147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310144 00000100:00100000:2.0:1788329922.407151:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310144 00000100:00100000:2.0:1788329922.407176:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788329922.407181:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3966919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5825:x1875199750310144:12345-0@lo:503: 00000100:00100000:2.0:1788329922.408266:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3966919 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5825:x1875199750310144:12345-0@lo:503: Request processed in 1075us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329922.408284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788329922.408704:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002084a154 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750310144:0@lo:503: 00000100:00100000:0.0:1788329922.409354:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000408d55dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5872:1875199750310272:0@lo:502: 00000100:00100000:0.0:1788329922.409506:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329922.409596:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b253d7c going to sleep for 11 seconds 00000100:00100000:2.0:1788329922.409659:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310272 00000100:00100000:2.0:1788329922.409667:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310272 00000100:00100000:2.0:1788329922.409739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788329922.409750:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8702f42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5872:x1875199750310272:12345-0@lo:502: 00000100:00100000:2.0:1788329922.410264:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8702f42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5872:x1875199750310272:12345-0@lo:502: Request processed in 514us (757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329922.410274:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788329922.410513:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000408d55dc pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5872:1875199750310272:0@lo:502: 00000020:01000004:1.0:1788329922.410642:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788329922.410678:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000007bc314c6) 00000020:00000080:1.0:1788329922.410718:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788329922.411707:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 000000009618bcf4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788329922.411719:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 000000009618bcf4 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788329922.411722:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 000000009618bcf4 4 00010000:00080000:0.0:1788329922.411790:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000004531d83@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.147@tcp at head 00010000:00010000:0.0:1788329922.415014:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788329922.415433:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788329922.415493:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788329922.415514:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x91094de4de9aa588 00000100:00080000:0.0:1788329922.415562:0:5872:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329922.415569:0:5872:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000004531d83 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:0.0:1788329922.415639:0:5872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b5be6001 x1875199750310400/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329922.415674:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788329922.415891:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b5be6001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750310400:0@lo:38: 00000100:00100000:1.0:1788329922.416011:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329922.416250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310400 00000100:00100000:3.0:1788329922.416266:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310400 00000100:00100000:3.0:1788329922.416330:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329922.416341:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fee818e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875199750310400:12345-0@lo:38: 00000100:00100000:3.0:1788329922.416443:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fee818e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875199750310400:12345-0@lo:38: Request processed in 102us (432us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788329922.416451:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329922.416504:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788329922.416548:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000004531d83 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788329922.416552:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788329922.416556:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b5be6001 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750310400:0@lo:38: 00000100:00100000:0.0:1788329922.417218:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007eea07c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5872:1875199750310528:0@lo:502: 00000100:00100000:0.0:1788329922.417321:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329922.417362:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e899d82d going to sleep for 11 seconds 00000100:00100000:0.0:1788329922.417399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310528 00000100:00100000:0.0:1788329922.417406:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310528 00000100:00100000:0.0:1788329922.417459:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788329922.417469:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000407d1cdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5872:x1875199750310528:12345-0@lo:502: 00000100:00100000:0.0:1788329922.417846:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000407d1cdc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5872:x1875199750310528:12345-0@lo:502: Request processed in 377us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329922.417994:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788329922.418066:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007eea07c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5872:1875199750310528:0@lo:502: 00000040:00080000:0.0:1788329922.418102:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788329922.418693:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788329922.418720:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788329922.418744:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329922.418755:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788329922.418829:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788329922.418833:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788329922.418834:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788329922.418835:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788329922.418837:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788329922.418838:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788329922.418839:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788329922.418841:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788329922.418843:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788329922.418844:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788329922.418846:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788329922.418847:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788329922.418979:0:5825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788329922.418983:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788329922.418984:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788329922.418985:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788329922.418986:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788329922.418987:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788329922.418987:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788329922.418988:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788329922.418990:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788329922.418990:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788329922.418991:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788329922.418992:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788329922.418993:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788329922.419018:0:5825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788329922.419039:0:5825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007eea07c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750310656:0@lo:253: 00000100:00100000:0.0:1788329922.419120:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329922.419207:0:5825:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e899d82d going to sleep for 11 seconds 00000100:00100000:3.0:1788329922.422062:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310656 00000100:00100000:3.0:1788329922.422081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310656 00000100:00100000:3.0:1788329922.422157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788329922.422167:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000047c45b5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5825:x1875199750310656:12345-0@lo:253: 20000000:01000000:3.0:1788329922.422234:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788329922.422254:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788329922.482570:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788329922.482592:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788329922.482669:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788329922.482677:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788329922.482721:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.482749:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa557 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.482758:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.482818:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa557 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329922.482838:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa557 expref: 12 pid: 5838 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329922.482926:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b246775 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875199750310784:0@lo:104: 00000100:00100000:1.0:1788329922.483021:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329922.483105:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007537a76 going to sleep for 11 seconds 00000100:00100000:3.0:1788329922.483206:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310784 00000100:00100000:3.0:1788329922.483217:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310784 00000100:00100000:3.0:1788329922.483299:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329922.483310:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000976a7ad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5860:x1875199750310784:12345-0@lo:104: 00010000:00010000:3.0:1788329922.483346:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.483426:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788329922.483433:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000976a7ad5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5860:x1875199750310784:12345-0@lo:104: Request processed in 125us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329922.483440:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788329922.483466:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329922.483473:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.483481:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006de8c57c already unused, calling callback (0000000052915c45) 10000000:00010000:3.0:1788329922.483484:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.483493:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329922.483499:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329922.483504:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329922.483572:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.483579:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329922.483599:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.483604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: 000000006de8c57c/0x91094de4de9aa557 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa55e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.483632:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329922.483633:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329922.483635:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329922.483724:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a680ee0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750310912:0@lo:103: 00000100:00100000:3.0:1788329922.483758:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329922.483838:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750310912 00000100:00100000:3.0:1788329922.483843:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750310912 00010000:00010000:3.0:1788329922.484016:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa557 expref: 13 pid: 5838 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329922.484049:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329922.484058:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f48baea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750310912:12345-0@lo:103: 00010000:00010000:3.0:1788329922.484071:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329922.484077:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa557 expref: 13 pid: 5838 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484087:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa557 expref: 13 pid: 5838 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484108:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484116:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788329922.484131:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001456260s 00010000:00010000:3.0:1788329922.484135:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484152:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484159:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484165:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484170:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e150419d already unused, calling callback (0000000068b72da7) 00010000:00010000:3.0:1788329922.484174:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484181:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484190:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484200:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329922.484232:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f48baea4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750310912:12345-0@lo:103: Request processed in 177us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329922.484240:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329922.484285:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a680ee0a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750310912:0@lo:103: 00010000:00010000:3.0:1788329922.484321:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f93c7f56/0x91094de4de9aa55e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa557 expref: 12 pid: 5838 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329922.484333:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b246775 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875199750310784:0@lo:104: 00010000:00010000:3.0:1788329922.484345:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484360:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484366:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329922.484372:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e150419d/0x91094de4de9aa58f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329922.502293:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000047c45b5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5825:x1875199750310656:12345-0@lo:253: Request processed in 80113us (83160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329922.502316:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788329922.502482:0:5825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007eea07c4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5825:1875199750310656:0@lo:253: 10000000:01000000:0.0:1788329922.502501:0:5825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788329922.502504:0:5825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788329922.502506:0:5825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788329922.502508:0:5825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788329922.502509:0:5825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788329922.502510:0:5825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788329922.502511:0:5825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788329922.502513:0:5825:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788329922.502515:0:5825:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788329922.502535:0:5825:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788329922.502537:0:5825:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788329922.502539:0:5825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788329922.502540:0:5825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788329922.502559:0:5825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788329922.512808:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788329922.514155:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788329922.514611:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788329922.514819:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788329922.516004:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788329922.516306:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788329922.519731:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788329922.520144:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788329922.520483:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329922.521239:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788329922.521777:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329922.522134:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788329922.581964:0:5825:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1788329922.644149:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788329922.644323:0:5877:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1788329922.644329:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788329922.644739:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788329922.647962:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788329922.648138:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788329922.648661:0:5825:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788329922.648670:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788329922.659589:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788329922.662136:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788329922.663775:0:5825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788329922.663862:0:5825:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788329922.664244:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788329922.675940:0:5825:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788329922.685125:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788329922.685283:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788329922.685466:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788329922.685656:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788329922.685828:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788329922.685972:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788329922.686110:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1788329922.686250:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1788329922.686402:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1788329922.686588:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1788329922.686775:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1788329922.686955:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1788329922.687115:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1788329922.687253:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1788329922.687407:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1788329922.687601:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788329922.688370:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788329922.688953:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788329922.689104:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788329922.689255:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788329922.689632:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788329922.689786:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788329922.689939:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788329922.690075:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1788329922.690217:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1788329922.690673:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1788329922.690852:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1788329922.691010:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1788329922.691161:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1788329922.691319:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1788329922.693292:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1788329922.693894:0:5825:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1788329922.694122:0:5825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788329922.728863:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1788329922.831940:0:5825:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788329922.832001:0:5825:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa44481e13988 00100000:10000000:0.0:1788329922.832012:0:5825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788329922.838811:0:5825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788329922.838842:0:5825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.147@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788329922.838866:0:5825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788329922.838891:0:5825:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788329922.924367:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788329922.924513:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788329922.924563:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:0.0:1788329923.189549:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329924.199021:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329925.216098:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329926.239136:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329927.262789:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788329927.840038:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788329927.840054:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788329927.840057:0:36:0:(import.c:65:import_set_state_nolock()) 0000000004531d83 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788329927.840074:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000004531d83 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:1.0:1788329927.840099:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004e8b5008 x1875199750311168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788329927.840422:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788329927.840442:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072629df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750311040:0@lo:400: 00000100:00100000:3.0:1788329927.840576:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329927.840663:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004e8b5008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750311168:0@lo:38: 00000100:00100000:3.0:1788329927.840695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329927.840813:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311040 00000100:00100000:1.0:1788329927.840826:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311040 00000100:00100000:1.0:1788329927.840895:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788329927.840905:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a82d4e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:3315:x1875199750311040:12345-0@lo:400: 00000100:00100000:1.0:1788329927.840969:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a82d4e1b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:3315:x1875199750311040:12345-0@lo:400: Request processed in 66us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329927.840976:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788329927.841045:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311168 00000100:00100000:1.0:1788329927.841049:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311168 00000100:00100000:1.0:1788329927.841066:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788329927.841071:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a680ee0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875199750311168:12345-0@lo:38: 00010000:00080000:1.0:1788329927.841099:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:1.0:1788329927.841140:0:5846:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x91094de4de9aa596 00000004:00100000:1.0:1788329927.841214:0:5846:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788329927.841357:0:5846:0:(import.c:65:import_set_state_nolock()) 00000000ce2cb6ad : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788329927.841399:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a680ee0a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875199750311168:12345-0@lo:38: Request processed in 327us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329927.841406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788329927.841664:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004e8b5008 x1875199750311168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788329937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788329927.841683:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788329927.841692:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788329927.841699:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788329927.841702:0:3311:0:(import.c:65:import_set_state_nolock()) 0000000004531d83 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788329927.841709:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004e8b5008 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750311168:0@lo:38: 00000100:00100000:3.0:1788329927.841742:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072629df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750311040:0@lo:400: 00010000:00010000:3.0:1788329928.291198:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329929.317115:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788329929.893275:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788329929.893287:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954689604000 from 3 10000000:01000000:3.0:1788329929.893294:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788329929.893353:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.893369:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.893384:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329929.893416:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009776aa8f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750311296:0@lo:101: 00000100:00100000:3.0:1788329929.893540:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329929.893714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311296 00000100:00100000:3.0:1788329929.893739:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311296 00000100:00100000:0.0:1788329929.893744:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d2f2bb7 going to sleep for 11 seconds 00000100:00100000:3.0:1788329929.893802:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788329929.893812:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b7160c20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5841:x1875199750311296:12345-0@lo:101: 00010000:00010000:3.0:1788329929.893830:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329929.893846:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000048ef3af6/0x91094de4de9aa5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa59d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.893880:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000048ef3af6/0x91094de4de9aa5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa59d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.893891:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000048ef3af6/0x91094de4de9aa5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa59d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.893902:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000048ef3af6, rc 0) 00000100:00100000:3.0:1788329929.893955:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b7160c20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750311296:12345-0@lo:101: Request processed in 144us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329929.893963:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788329929.894026:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009776aa8f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750311296:0@lo:101: 00010000:00010000:3.0:1788329929.894045:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.894054:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329929.894118:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009776aa8f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750311424:0@lo:256: 00000100:00100000:3.0:1788329929.894152:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329929.894167:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set 000000003d2f2bb7 going to sleep for 11 seconds 00000100:00100000:3.0:1788329929.894181:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311424 00000100:00100000:3.0:1788329929.894185:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311424 00000100:00100000:3.0:1788329929.894212:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788329929.894218:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008c6e3769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750311424:12345-0@lo:256: 20000000:01000000:3.0:1788329929.894233:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788329929.894253:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788329929.894257:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1788329929.894340:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008c6e3769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750311424:12345-0@lo:256: Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329929.894348:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788329929.894377:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009776aa8f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750311424:0@lo:256: 10000000:01000000:3.0:1788329929.894422:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788329929.894428:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329929.894437:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 00000000792e6ad7/0x91094de4de9aa59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788329930.030286:0:6122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788329930.345044:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329931.365799:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329932.392569:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329932.961811:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788329932.961840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d505d7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750311680:0@lo:400: 00000100:00100000:3.0:1788329932.961930:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329932.962118:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311680 00000100:00100000:1.0:1788329932.962132:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311680 00000100:00100000:1.0:1788329932.962185:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788329932.962194:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f325dba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750311680:12345-0@lo:400: 00000100:00100000:1.0:1788329932.962256:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f325dba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750311680:12345-0@lo:400: Request processed in 65us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329932.962264:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329932.962351:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009776aa8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750311552:0@lo:400: 00000100:00100000:0.0:1788329932.962392:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329932.962476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311552 00000100:00100000:1.0:1788329932.962480:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311552 00000100:00100000:1.0:1788329932.962513:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788329932.962537:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc7db1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3315:x1875199750311552:12345-0@lo:400: 00000100:00100000:1.0:1788329932.962593:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc7db1d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3315:x1875199750311552:12345-0@lo:400: Request processed in 56us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329932.962600:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788329932.962684:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009776aa8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750311552:0@lo:400: 00010000:00080000:3.0:1788329932.962835:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006d505d7c x1875199750311680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329932.962849:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d505d7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750311680:0@lo:400: 00010000:00010000:2.0:1788329933.407104:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329934.430826:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329935.465700:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788329936.011370:0:6324:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6d5f3940 20000000:00000080:3.0:1788329936.011396:0:6324:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9546bf18b400 uarg=0000000000000000 20000000:01000000:3.0:1788329936.011435:0:6324:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788329936.011449:0:6324:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788329936.011454:0:6324:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788329936.012201:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788329936.012279:0:6324:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788329936.022129:0:6324:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788329936.027919:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788329936.028032:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788329936.028088:0:6324:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788329936.028114:0:6324:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788329936.028142:0:6324:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329936.028185:0:6324:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa565 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329936.028194:0:6324:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329936.028566:0:6324:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa565 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329936.028585:0:6324:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa565 expref: 11 pid: 5837 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329936.028606:0:6324:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006d505d7c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875199750311808:0@lo:104: 00000100:00100000:3.0:1788329936.028699:0:6324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329936.028771:0:6324:0:(client.c:2715:ptlrpc_set_wait()) set 000000008e18a254 going to sleep for 11 seconds 00000100:00100000:1.0:1788329936.028837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311808 00000100:00100000:1.0:1788329936.028846:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311808 00000100:00100000:1.0:1788329936.028903:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788329936.028914:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eb5f06c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:6324:x1875199750311808:12345-0@lo:104: 00010000:00010000:1.0:1788329936.028932:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329936.029027:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329936.029034:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eb5f06c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:6324:x1875199750311808:12345-0@lo:104: Request processed in 121us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329936.029040:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788329936.029121:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788329936.029128:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029136:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ff665bb already unused, calling callback (0000000052915c45) 10000000:00010000:2.0:1788329936.029139:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029148:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329936.029157:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329936.029162:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788329936.029207:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029214:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329936.029235:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029242:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa565 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa56c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029262:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329936.029264:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329936.029265:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329936.029278:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f3ef183 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750311936:0@lo:103: 00000100:00100000:2.0:1788329936.029312:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329936.029369:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750311936 00000100:00100000:2.0:1788329936.029373:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750311936 00010000:00010000:2.0:1788329936.029393:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa565 expref: 12 pid: 5837 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329936.029416:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329936.029421:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cffffaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3313:x1875199750311936:12345-0@lo:103: 00000100:00100000:0.0:1788329936.029422:0:6324:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006d505d7c pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6324:1875199750311808:0@lo:104: 00010000:00010000:2.0:1788329936.029432:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329936.029438:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa565 expref: 12 pid: 5837 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329936.029446:0:6324:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029448:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa565 expref: 12 pid: 5837 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.029462:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000091a7ca60/0x91094de4de9aa56c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa565 expref: 12 pid: 5837 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037145:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037172:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037205:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037213:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037220:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037249:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037256:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000025762c60 already unused, calling callback (0000000068b72da7) 00010000:00010000:2.0:1788329936.037261:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037269:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037290:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329936.037306:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329936.037438:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cffffaf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:3313:x1875199750311936:12345-0@lo:103: Request processed in 8010us (8119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329936.037452:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329936.037718:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f3ef183 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750311936:0@lo:103: 00010000:00010000:0.0:1788329936.038979:0:6324:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329936.039016:0:6324:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329936.039022:0:6324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000025762c60/0x91094de4de9aa5ab lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6324 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329936.478856:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329937.503670:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329938.079041:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef3a9185 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750312192:0@lo:400: 00000100:00100000:1.0:1788329938.079221:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329938.079349:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007eea07c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750312064:0@lo:400: 00000100:00100000:2.0:1788329938.079392:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329938.079484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312064 00000100:00100000:2.0:1788329938.079493:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312064 00000100:00100000:2.0:1788329938.079591:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788329938.079602:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071376981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:3314:x1875199750312064:12345-0@lo:400: 00000100:00100000:2.0:1788329938.079658:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071376981 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:3314:x1875199750312064:12345-0@lo:400: Request processed in 58us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329938.079666:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788329938.079718:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007eea07c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750312064:0@lo:400: 00000100:00100000:0.0:1788329938.080459:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312192 00000100:00100000:0.0:1788329938.080468:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312192 00000100:00100000:0.0:1788329938.080513:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788329938.080546:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003459f61a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750312192:12345-0@lo:400: 00000100:00100000:0.0:1788329938.080608:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003459f61a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750312192:12345-0@lo:400: Request processed in 74us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329938.080616:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788329938.081445:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ef3a9185 x1875199750312192/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329938.081462:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef3a9185 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750312192:0@lo:400: 00010000:00010000:2.0:1788329938.534615:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329939.551632:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329940.583615:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329941.600029:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329942.622701:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788329942.873751:0:6674:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788329942.873755:0:6674:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788329942.873889:0:6674:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000000c8fc546 00000020:01000004:2.0:1788329942.873906:0:6674:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788329942.873918:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788329942.873932:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000ae311e4a) 00000020:00000080:2.0:1788329942.873947:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788329942.889846:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788329942.890105:0:6674:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788329942.915823:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788329942.922103:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788329942.922142:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788329942.922199:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788329942.922227:0:6674:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788329942.925498:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788329942.925515:0:6674:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788329942.925706:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x91094de4de9aa5b9 00000020:01000004:2.0:1788329942.925715:0:6674:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788329942.925739:0:6674:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.147@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788329942.925742:0:6674:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788329942.925750:0:6674:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788329942.925755:0:6674:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788329942.925768:0:6674:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000000d2f9d1a) 00000020:00000080:2.0:1788329942.925779:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788329942.927011:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329942.927212:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788329942.927220:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788329942.927946:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788329942.927954:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788329942.928266:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788329942.928273:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788329942.930715:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329942.930854:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788329942.930858:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788329942.936925:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788329942.936939:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788329942.969089:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788329942.969409:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788329942.969416:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788329942.970950:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788329942.970964:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788329942.972373:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788329942.972386:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788329942.977888:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788329942.978100:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788329942.978106:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788329942.978925:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788329942.978934:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788329943.060176:0:6674:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788329943.060424:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788329943.060431:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788329943.061783:0:6674:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788329943.061798:0:6674:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788329943.062369:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788329943.062394:0:6674:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788329943.062400:0:6674:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788329943.109257:0:6674:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788329943.109299:0:6674:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.147@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788329943.109303:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788329943.109306:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788329943.109584:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788329943.109587:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788329943.109588:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788329943.109590:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788329943.109592:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788329943.109593:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788329943.109594:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788329943.109596:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788329943.109597:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788329943.109601:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788329943.109603:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788329943.109604:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788329943.109605:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788329943.109606:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788329943.109607:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788329943.109614:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788329943.109615:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788329943.109616:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788329943.109617:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788329943.109618:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788329943.109618:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788329943.109649:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788329943.109668:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a1c0b528 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750312320:0@lo:253: 00000100:00100000:0.0:1788329943.109754:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329943.109851:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000005bb4290e going to sleep for 11 seconds 00000100:00100000:1.0:1788329943.112712:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312320 00000100:00100000:1.0:1788329943.112729:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312320 00000100:00100000:1.0:1788329943.112855:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788329943.112867:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000052eef3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750312320:12345-0@lo:253: 20000000:01000000:1.0:1788329943.112911:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788329943.112919:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788329943.112925:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788329943.112929:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788329943.114105:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788329943.114300:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788329943.114955:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788329943.115012:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788329943.115020:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788329943.115046:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788329943.115098:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1788329943.115729:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1788329943.115753:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.147@tcp 20000000:01000000:1.0:1788329943.115754:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788329943.115789:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1788329943.115797:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788329943.115844:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1788329943.115852:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.147@tcp (null) (null) 00000040:00080000:1.0:1788329943.115904:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1788329943.115915:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788329943.115947:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1788329943.115994:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1788329943.117264:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1788329943.117290:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.147@tcp 20000000:01000000:1.0:1788329943.117292:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.147@tcp (null) (null) (null) 00000040:00080000:1.0:1788329943.117396:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1788329943.117405:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788329943.117439:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1788329943.117446:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.147@tcp (null) (null) 00000040:00080000:1.0:1788329943.117504:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1788329943.117514:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1788329943.117966:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1788329943.118000:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1788329943.118019:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788329943.118022:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788329943.118028:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788329943.118029:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788329943.118031:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788329943.118043:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788329943.118045:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788329943.118080:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788329943.118082:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788329943.118694:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788329943.118751:0:6689:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788329943.118804:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1788329943.119107:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1788329943.119143:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1788329943.119195:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1788329943.119207:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788329943.119210:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788329943.119770:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1788329943.119978:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1788329943.120017:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1788329943.120069:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1788329943.120090:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788329943.120092:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788329943.120620:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788329943.120678:0:6691:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788329943.120723:0:6691:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788329943.120973:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788329943.121009:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788329943.121039:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1788329943.121057:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788329943.121074:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121092:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121099:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa503 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121105:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa573 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121111:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121150:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa573 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121164:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa573 expref: 11 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329943.121186:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a6894a99 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750312448:0@lo:104: 00000100:00100000:0.0:1788329943.121247:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788329943.121413:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa503 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.121422:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa503 expref: 11 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329943.121430:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aecdf9b0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750312576:0@lo:104: 00000100:00100000:0.0:1788329943.121451:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.122811:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312448 00000100:00100000:3.0:1788329943.122824:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312448 00000100:00100000:2.0:1788329943.122929:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312576 00000100:00100000:2.0:1788329943.122934:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312576 00000100:00100000:2.0:1788329943.122953:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788329943.122961:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007bedb670 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:5837:x1875199750312448:12345-0@lo:104: 00010000:00010000:2.0:1788329943.122979:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.123058:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788329943.123087:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007bedb670 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:5837:x1875199750312448:12345-0@lo:104: Request processed in 127us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.123095:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788329943.123111:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788329943.123117:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e14e7d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5837:x1875199750312576:12345-0@lo:104: 00010000:00010000:2.0:1788329943.123125:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.123159:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788329943.123163:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e14e7d5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5837:x1875199750312576:12345-0@lo:104: Request processed in 48us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.123168:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788329943.123226:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788329943.123231:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123238:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000a8116e0 already unused, calling callback (0000000052915c45) 10000000:00010000:3.0:1788329943.123242:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123250:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329943.123256:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329943.123274:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329943.123330:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123337:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329943.123353:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123359:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: 000000000a8116e0/0x91094de4de9aa573 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa57a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123373:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329943.123375:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123380:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000059dea36c already unused, calling callback (0000000052915c45) 10000000:00010000:3.0:1788329943.123382:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123387:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329943.123391:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329943.123396:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329943.123407:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123413:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329943.123425:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123431:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: 0000000059dea36c/0x91094de4de9aa503 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa50a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123440:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329943.123442:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329943.123444:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329943.123458:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750312832:0@lo:103: 00000100:00100000:3.0:1788329943.123506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.123570:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788329943.123576:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000074702eea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750312704:0@lo:103: 00000100:00100000:3.0:1788329943.123596:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.123621:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312832 00000100:00100000:3.0:1788329943.123626:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312832 00010000:00010000:3.0:1788329943.123649:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa503 expref: 12 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329943.123666:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312704 00000100:00100000:3.0:1788329943.123669:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312704 00010000:00010000:3.0:1788329943.123677:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa573 expref: 13 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329943.123689:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329943.123694:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de03288b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750312832:12345-0@lo:103: 00010000:00010000:3.0:1788329943.123703:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329943.123706:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa503 expref: 13 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123724:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa503 expref: 13 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123743:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329943.123769:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de03288b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750312832:12345-0@lo:103: Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329943.123775:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329943.123788:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788329943.123793:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d879c20c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3313:x1875199750312704:12345-0@lo:103: 00010000:00010000:3.0:1788329943.123799:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329943.123802:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa573 expref: 12 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123810:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa573 expref: 12 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.123818:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329943.123835:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d879c20c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3313:x1875199750312704:12345-0@lo:103: Request processed in 42us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329943.123840:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788329943.123867:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000074702eea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750312704:0@lo:103: 00000100:00100000:3.0:1788329943.123874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750312832:0@lo:103: 00010000:00010000:0.0:1788329943.124114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329943.124195:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.124207:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 11 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.124217:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dc23b411 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750312960:0@lo:104: 00000100:00100000:1.0:1788329943.124244:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.124303:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set 000000000f3b2877 going to sleep for 11 seconds 00010000:00010000:1.0:1788329943.124328:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007d21ceb7/0x91094de4de9aa57a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa573 expref: 11 pid: 5837 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.124340:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a6894a99 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750312448:0@lo:104: 00010000:00010000:1.0:1788329943.124349:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000010b0f4ef/0x91094de4de9aa50a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa503 expref: 10 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.124360:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aecdf9b0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750312576:0@lo:104: 00000100:00100000:2.0:1788329943.124443:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750312960 00000100:00100000:2.0:1788329943.124448:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750312960 00000100:00100000:2.0:1788329943.124552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329943.124560:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001719f53c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5837:x1875199750312960:12345-0@lo:104: 00010000:00010000:2.0:1788329943.124568:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.124616:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788329943.124621:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001719f53c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5837:x1875199750312960:12345-0@lo:104: Request processed in 64us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.124627:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788329943.124688:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dc23b411 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750312960:0@lo:104: 00010000:00010000:3.0:1788329943.124718:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.124767:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788329943.124772:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.124778:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c5bc5b1a already unused, calling callback (0000000052915c45) 10000000:00010000:0.0:1788329943.124780:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.124786:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788329943.124792:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329943.124797:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788329943.124828:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.124846:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788329943.124862:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.124867:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: 00000000c5bc5b1a/0x91094de4de9aa4e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa4ee expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.124885:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329943.124887:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329943.124888:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329943.124973:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b6599995 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750313088:0@lo:103: 00000100:00100000:2.0:1788329943.124998:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.125079:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313088 00000100:00100000:3.0:1788329943.125087:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313088 00010000:00010000:3.0:1788329943.125101:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 10 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329943.125155:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788329943.125162:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000388b87a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:3314:x1875199750313088:12345-0@lo:103: 00010000:00010000:3.0:1788329943.125170:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329943.125174:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 10 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125182:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 10 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125191:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000b960291/0x91094de4de9aa4ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa4e7 expref: 10 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125204:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125211:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125222:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125228:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125234:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125239:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125251:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000393948f already unused, calling callback (0000000068b72da7) 00010000:00010000:3.0:1788329943.125254:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125260:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125280:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.125290:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329943.125339:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000388b87a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:3314:x1875199750313088:12345-0@lo:103: Request processed in 178us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329943.125346:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788329943.125396:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b6599995 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750313088:0@lo:103: 00010000:00010000:1.0:1788329943.125673:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.125682:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.125687:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000393948f/0x91094de4de9aa5c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788329943.125699:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788329943.171620:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000052eef3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+8:6674:x1875199750312320:12345-0@lo:253: Request processed in 58749us (61859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.171636:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788329943.171745:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a1c0b528 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750312320:0@lo:253: 10000000:01000000:1.0:1788329943.171769:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788329943.171772:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788329943.171775:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788329943.171776:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329943.171777:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788329943.171779:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329943.171780:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329943.171781:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329943.171782:0:6674:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788329943.171784:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329943.171785:0:6674:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788329943.171802:0:6674:0:(tgt_mount.c:101:server_register_mount()) register mount 000000000c8fc546 from lustre-OST0000 10000000:01000000:1.0:1788329943.171824:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788329943.171827:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788329943.171833:0:6674:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9546b4ba4d28 local copy 10000000:01000000:1.0:1788329943.171837:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788329943.171869:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.171879:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.171887:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.171903:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313216:0@lo:101: 00000100:00100000:1.0:1788329943.171936:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.171989:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc2a6051 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.172125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313216 00000100:00100000:0.0:1788329943.172133:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313216 00000100:00100000:0.0:1788329943.172172:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788329943.172180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000db71a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+8:6674:x1875199750313216:12345-0@lo:101: 00010000:00010000:0.0:1788329943.172254:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329943.172267:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009c71be1a/0x91094de4de9aa5d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa5ce expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.172289:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009c71be1a/0x91094de4de9aa5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa5ce expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.172298:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009c71be1a/0x91094de4de9aa5d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa5ce expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.172317:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009c71be1a, rc 0) 00000100:00100000:0.0:1788329943.172353:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000db71a76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:6674:x1875199750313216:12345-0@lo:101: Request processed in 174us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.172359:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788329943.172439:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313216:0@lo:101: 00010000:00010000:1.0:1788329943.172451:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.172469:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.172608:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313344:0@lo:501: 00000100:00100000:1.0:1788329943.172634:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.172651:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cc2a6051 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.172706:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313344 00000100:00100000:2.0:1788329943.172710:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313344 00000100:00100000:2.0:1788329943.172742:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788329943.172754:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003629f7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:6674:x1875199750313344:12345-0@lo:501: 00000100:00100000:2.0:1788329943.172959:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003629f7e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:6674:x1875199750313344:12345-0@lo:501: Request processed in 205us (324us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788329943.172966:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788329943.173040:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313344:0@lo:501: 10000000:01000000:1.0:1788329943.173055:0:6674:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788329943.173079:0:6674:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788329943.173083:0:6674:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.173090:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.173096:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.173120:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788329943.173141:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9546a001c800 10000000:01000000:1.0:1788329943.173145:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788329943.173149:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9546b4ba4d28 10000000:01000000:1.0:1788329943.173152:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788329943.173155:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9546b4ba4d28 from 1 10000000:01000000:1.0:1788329943.173158:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788329943.173172:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.173203:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.173211:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.173224:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313472:0@lo:101: 00000100:00100000:1.0:1788329943.173248:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.173260:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000007232c6e5 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.173373:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313472 00000100:00100000:0.0:1788329943.173379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313472 00000100:00100000:0.0:1788329943.173412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788329943.173418:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005928f4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:6674:x1875199750313472:12345-0@lo:101: 00010000:00010000:0.0:1788329943.173426:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329943.173436:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000004e4ffc9/0x91094de4de9aa5e3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa5dc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.173449:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000004e4ffc9/0x91094de4de9aa5e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa5dc expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.173457:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000004e4ffc9/0x91094de4de9aa5e3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa5dc expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.173464:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000004e4ffc9, rc 0) 00000100:00100000:0.0:1788329943.173503:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005928f4eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750313472:12345-0@lo:101: Request processed in 85us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.173509:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788329943.173600:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788329943.173606:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.173614:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008ff665bb already unused, calling callback (0000000052915c45) 10000000:00010000:2.0:1788329943.173617:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.173624:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788329943.173631:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329943.173637:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788329943.173656:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.173663:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788329943.173691:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.173698:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: 000000008ff665bb/0x91094de4de9aa5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x91094de4de9aa5d5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.173715:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329943.173725:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329943.173727:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329943.173736:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788329943.173748:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa9b4042 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750313600:0@lo:103: 00000100:00100000:2.0:1788329943.173779:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329943.173813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313600 00000100:00100000:2.0:1788329943.173817:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313600 00000100:00100000:2.0:1788329943.173849:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329943.173855:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d832a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:3314:x1875199750313600:12345-0@lo:103: 00010000:00010000:2.0:1788329943.173863:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329943.173875:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009c71be1a/0x91094de4de9aa5d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa5ce expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.173886:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329943.173909:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d832a7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:3314:x1875199750313600:12345-0@lo:103: Request processed in 55us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.173915:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788329943.173941:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa9b4042 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750313600:0@lo:103: 00000100:00100000:1.0:1788329943.174044:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313472:0@lo:101: 00010000:00010000:1.0:1788329943.174056:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.174063:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329943.174077:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788329943.174094:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.174100:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 00000000e9132ce8/0x91094de4de9aa5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329943.174107:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788329943.174111:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788329943.174115:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788329943.174118:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788329943.174129:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.174141:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.174149:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.174161:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313728:0@lo:101: 00000100:00100000:1.0:1788329943.174253:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.174274:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000007232c6e5 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.174324:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313728 00000100:00100000:0.0:1788329943.174328:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313728 00000100:00100000:0.0:1788329943.174358:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788329943.174364:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da06ef59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:6674:x1875199750313728:12345-0@lo:101: 00010000:00010000:0.0:1788329943.174373:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329943.174386:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000027398221/0x91094de4de9aa5f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa5ea expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.174400:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000027398221/0x91094de4de9aa5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.174408:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000027398221/0x91094de4de9aa5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.174414:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000027398221, rc 0) 00000100:00100000:0.0:1788329943.174440:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da06ef59 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750313728:12345-0@lo:101: Request processed in 77us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.174446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788329943.174564:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313728:0@lo:101: 00010000:00010000:1.0:1788329943.174573:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.174580:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.174665:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313856:0@lo:501: 00000100:00100000:1.0:1788329943.174690:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.174706:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000007232c6e5 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.174824:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313856 00000100:00100000:0.0:1788329943.174829:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313856 00000100:00100000:0.0:1788329943.174859:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788329943.174865:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d38bb36c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750313856:12345-0@lo:501: 00000100:00100000:0.0:1788329943.175081:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d38bb36c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750313856:12345-0@lo:501: Request processed in 216us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.175087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788329943.175387:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313856:0@lo:501: 00000100:00100000:1.0:1788329943.175417:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313984:0@lo:503: 00000100:00100000:1.0:1788329943.175457:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.175483:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000007232c6e5 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.175623:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750313984 00000100:00100000:2.0:1788329943.175628:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750313984 00000100:00100000:2.0:1788329943.175654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788329943.175659:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000563882b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750313984:12345-0@lo:503: 00000100:00100000:2.0:1788329943.175818:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000563882b7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750313984:12345-0@lo:503: Request processed in 158us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.175824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788329943.175973:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b4b21513 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750313984:0@lo:503: 00000040:00080000:3.0:1788329943.176259:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788329943.176308:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314112:0@lo:502: 00000100:00100000:3.0:1788329943.176339:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.176365:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045cd44c5 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.176408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314112 00000100:00100000:2.0:1788329943.176413:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314112 00000100:00100000:2.0:1788329943.176443:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788329943.176456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000057cdaeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750314112:12345-0@lo:502: 00000100:00100000:2.0:1788329943.176658:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000057cdaeaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750314112:12345-0@lo:502: Request processed in 202us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.176665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788329943.176789:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314112:0@lo:502: 00000040:00080000:3.0:1788329943.176969:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788329943.176999:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788329943.177014:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788329943.177037:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788329943.177054:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788329943.177069:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788329943.177084:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314240:0@lo:502: 00000100:00100000:3.0:1788329943.177115:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.177137:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000045cd44c5 going to sleep for 11 seconds 00000100:00100000:1.0:1788329943.177179:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314240 00000100:00100000:1.0:1788329943.177235:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314240 00000100:00100000:1.0:1788329943.177261:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788329943.177270:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef1acc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750314240:12345-0@lo:502: 00000100:00100000:1.0:1788329943.177373:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef1acc2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750314240:12345-0@lo:502: Request processed in 103us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329943.177378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788329943.177494:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314240:0@lo:502: 00000040:00080000:3.0:1788329943.177605:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788329943.177615:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788329943.178032:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788329943.178039:0:6693:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788329943.178044:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329943.178046:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788329943.178049:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788329943.178065:0:6693:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000009da7780c) 00000020:00000080:3.0:1788329943.178083:0:6693:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788329943.178087:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788329943.178138:0:6693:0:(tgt_mount.c:153:server_get_mount()) get mount 000000000c8fc546 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788329943.178142:0:6693:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788329943.178148:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x91094de4de9aa5ff 00010000:00010000:3.0:1788329943.181076:0:6693:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788329943.181423:0:6693:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788329943.183136:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788329943.183506:0:6693:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788329943.188165:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788329943.188580:0:6693:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788329943.189870:0:6693:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788329943.189885:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788329943.189892:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329943.189894:0:6693:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788329943.189898:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788329943.189902:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329943.189903:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788329943.189905:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788329943.189907:0:6693:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788329943.189958:0:6693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788329943.189961:0:6693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329943.189962:0:6693:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788329943.189965:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788329943.190233:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788329943.190265:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788329943.190284:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.190296:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: 00000000e4a812a7/0x91094de4de9aa5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329943.190304:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9546a001c800 from 1 10000000:01000000:3.0:1788329943.190307:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788329943.190343:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: 0000000075a8d05d/0x91094de4de9aa606 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.190359:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: 0000000075a8d05d/0x91094de4de9aa606 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.190371:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: 0000000075a8d05d/0x91094de4de9aa606 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329943.190404:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314368:0@lo:101: 00000100:00100000:3.0:1788329943.190821:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.190914:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029620261 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.190991:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314368 00000100:00100000:2.0:1788329943.191000:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314368 00000100:00100000:2.0:1788329943.191079:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788329943.191087:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d3fb101e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+10:6674:x1875199750314368:12345-0@lo:101: 00010000:00010000:2.0:1788329943.191100:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329943.191113:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001fb3fadc/0x91094de4de9aa60d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa606 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.191134:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001fb3fadc/0x91094de4de9aa60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa606 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.191151:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001fb3fadc/0x91094de4de9aa60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa606 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.191159:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001fb3fadc, rc 0) 00000100:00100000:2.0:1788329943.191201:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d3fb101e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314368:12345-0@lo:101: Request processed in 115us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.191208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788329943.191279:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314368:0@lo:101: 00010000:00010000:3.0:1788329943.191293:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: 0000000075a8d05d/0x91094de4de9aa606 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.191301:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: 0000000075a8d05d/0x91094de4de9aa606 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329943.191401:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314496:0@lo:501: 00000100:00100000:3.0:1788329943.192568:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.192600:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029620261 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.192673:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314496 00000100:00100000:2.0:1788329943.192681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314496 00000100:00100000:2.0:1788329943.192722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788329943.192729:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b7d4518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314496:12345-0@lo:501: 00000100:00100000:2.0:1788329943.192982:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b7d4518 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314496:12345-0@lo:501: Request processed in 253us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.192990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788329943.193144:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314496:0@lo:501: 00000100:00100000:3.0:1788329943.193189:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314624:0@lo:503: 00000100:00100000:3.0:1788329943.193229:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.193257:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029620261 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.193272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314624 00000100:00100000:0.0:1788329943.193277:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314624 00000100:00100000:0.0:1788329943.193313:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788329943.193320:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fabe5934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314624:12345-0@lo:503: 00000100:00100000:0.0:1788329943.193554:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fabe5934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314624:12345-0@lo:503: Request processed in 235us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.193561:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788329943.193609:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c330d959 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314624:0@lo:503: 00000040:00080000:2.0:1788329943.193913:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788329943.193980:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa9b4042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314752:0@lo:502: 00000100:00100000:2.0:1788329943.194014:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329943.194037:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 000000000b4ec588 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.194051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314752 00000100:00100000:2.0:1788329943.194055:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314752 00000100:00100000:2.0:1788329943.194089:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788329943.194095:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000090c7ecef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314752:12345-0@lo:502: 00000100:00100000:2.0:1788329943.194252:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000090c7ecef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314752:12345-0@lo:502: Request processed in 156us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.194259:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788329943.194273:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa9b4042 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314752:0@lo:502: 00000040:00080000:1.0:1788329943.194506:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788329943.194580:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788329943.194603:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001b884c7b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314880:0@lo:502: 00000100:00100000:1.0:1788329943.194637:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.194658:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set 0000000016062dca going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.194713:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750314880 00000100:00100000:0.0:1788329943.194718:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750314880 00000100:00100000:0.0:1788329943.194744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788329943.194749:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d7294e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314880:12345-0@lo:502: 00000100:00100000:0.0:1788329943.194956:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d7294e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750314880:12345-0@lo:502: Request processed in 206us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.194962:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788329943.195777:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001b884c7b pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750314880:0@lo:502: 00000040:00080000:2.0:1788329943.195908:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788329943.195922:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788329943.196506:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788329943.196659:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329943.196663:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788329943.196671:0:6697:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9546a001c800 00000020:00000080:1.0:1788329943.196675:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788329943.196724:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788329943.196727:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329943.196729:0:6697:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788329943.196732:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788329943.196848:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788329943.196879:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788329943.196902:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.196914:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329943.196951:0:6674:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788329943.196954:0:6674:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9546a001c800 10000000:01000000:2.0:1788329943.196957:0:6674:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9546a001c800 10000000:01000000:2.0:1788329943.196961:0:6674:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788329943.196967:0:6674:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9546a001c800 from 1 10000000:01000000:2.0:1788329943.196970:0:6674:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788329943.196999:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.197007:0:6674:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329943.197016:0:6674:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329943.197034:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315008:0@lo:101: 00000100:00100000:2.0:1788329943.197085:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329943.197184:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980000 going to sleep for 11 seconds 00000100:00100000:1.0:1788329943.197218:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315008 00000100:00100000:1.0:1788329943.197226:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315008 00000100:00100000:1.0:1788329943.197295:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788329943.197305:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750315008:12345-0@lo:101: 00010000:00010000:1.0:1788329943.197319:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329943.197333:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa614 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.197360:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa614 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.197388:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa614 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.197399:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cde00, rc 0) 00000100:00100000:1.0:1788329943.197448:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315008:12345-0@lo:101: Request processed in 144us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329943.197455:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788329943.197673:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315008:0@lo:101: 00010000:00010000:1.0:1788329943.197687:0:6674:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.197696:0:6674:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.197793:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315136:0@lo:501: 00000100:00100000:1.0:1788329943.197819:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.197875:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15300 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.197908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315136 00000100:00100000:0.0:1788329943.197913:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315136 00000100:00100000:0.0:1788329943.197974:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788329943.197981:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315136:12345-0@lo:501: 00000100:00100000:0.0:1788329943.198221:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315136:12345-0@lo:501: Request processed in 240us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.198228:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788329943.198284:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315136:0@lo:501: 00000100:00100000:1.0:1788329943.198310:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315264:0@lo:503: 00000100:00100000:1.0:1788329943.198342:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.198417:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15300 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.198445:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315264 00000100:00100000:2.0:1788329943.198455:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315264 00000100:00100000:2.0:1788329943.198476:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788329943.198482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315264:12345-0@lo:503: 00000100:00100000:2.0:1788329943.198741:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315264:12345-0@lo:503: Request processed in 257us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329943.198749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788329943.199067:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315264:0@lo:503: 00000040:00080000:1.0:1788329943.199359:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788329943.199414:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315520:0@lo:502: 00000100:00100000:1.0:1788329943.199451:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329943.199551:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750315392:0@lo:400: 00000100:00100000:2.0:1788329943.199624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.199767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315392 00000100:00100000:1.0:1788329943.199772:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315392 00000100:00100000:1.0:1788329943.199850:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788329943.199861:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750315392:12345-0@lo:400: 00000100:00100000:1.0:1788329943.199914:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750315392:12345-0@lo:400: Request processed in 55us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329943.199920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788329943.199971:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9546bfdb3100 x1875199750315392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329943.199983:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750315392:0@lo:400: 00000100:00100000:1.0:1788329943.200051:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15300 going to sleep for 11 seconds 00000100:00100000:3.0:1788329943.200720:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315520 00000100:00100000:3.0:1788329943.200727:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315520 00000100:00100000:3.0:1788329943.200763:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788329943.200778:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315520:12345-0@lo:502: 00000100:00100000:3.0:1788329943.200945:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315520:12345-0@lo:502: Request processed in 167us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329943.200950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788329943.201025:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315520:0@lo:502: 00000040:00080000:1.0:1788329943.201221:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788329943.201265:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788329943.201284:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788329943.201309:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788329943.201327:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788329943.201361:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788329943.201383:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788329943.201403:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788329943.201448:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788329943.201495:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788329943.201607:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788329943.201672:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788329943.201710:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788329943.201743:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788329943.201788:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788329943.201823:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788329943.201856:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788329943.201903:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788329943.201938:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788329943.201971:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788329943.202019:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788329943.202051:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788329943.202079:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788329943.202105:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788329943.202123:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788329943.202140:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788329943.202177:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788329943.202224:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1788329943.202261:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315648:0@lo:502: 00000100:00100000:1.0:1788329943.202302:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.202337:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15300 going to sleep for 11 seconds 00000100:00100000:3.0:1788329943.202404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315648 00000100:00100000:3.0:1788329943.202410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315648 00000100:00100000:3.0:1788329943.202449:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788329943.202457:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315648:12345-0@lo:502: 00000100:00100000:3.0:1788329943.202682:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315648:12345-0@lo:502: Request processed in 224us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329943.202689:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788329943.202791:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315648:0@lo:502: 00000040:00080000:2.0:1788329943.202861:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788329943.202872:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788329943.203512:0:6698:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788329943.203565:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff954585308000) 00000020:00000080:2.0:1788329943.203585:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788329943.203663:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9546a001c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788329943.203668:0:6698:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9546a001c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788329943.203670:0:6698:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9546a001c800 3 00010000:00080000:2.0:1788329943.203699:0:6698:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9545852f5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.147@tcp at head 00010000:00010000:2.0:1788329943.205178:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788329943.205363:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788329943.205392:0:6698:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788329943.205404:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x91094de4de9aa629 00000100:00080000:2.0:1788329943.205414:0:6698:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788329943.205420:0:6698:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9545852f5800 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:2.0:1788329943.205462:0:6698:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546beffa680 x1875199750315776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788329943.205481:0:6698:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788329943.205762:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875199750315776:0@lo:38: 00000100:00100000:3.0:1788329943.205831:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329943.207761:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315776 00000100:00100000:1.0:1788329943.207776:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315776 00000100:00100000:1.0:1788329943.207833:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788329943.207842:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875199750315776:12345-0@lo:38: 00010000:00080000:1.0:1788329943.207875:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1788329943.207912:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x91094de4de9aa630 00000004:00100000:1.0:1788329943.207932:0:5845:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788329943.207968:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9545849c6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788329943.208063:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875199750315776:12345-0@lo:38: Request processed in 221us (2231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329943.208070:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788329943.208119:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9546beffa680 x1875199750315776/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788329953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329943.208131:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788329943.208139:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788329943.208146:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788329943.208150:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788329943.208153:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9545852f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788329943.208159:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875199750315776:0@lo:38: 00000040:00080000:1.0:1788329943.208331:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788329943.208648:0:6674:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788329943.208668:0:6674:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788329943.208732:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.208740:0:6674:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788329943.208774:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788329943.208775:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788329943.208776:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788329943.208777:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788329943.208777:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788329943.208778:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788329943.208780:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788329943.208781:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788329943.208782:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788329943.208786:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788329943.208787:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788329943.208789:0:6674:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788329943.208791:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788329943.208792:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788329943.208792:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788329943.208793:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788329943.208793:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788329943.208794:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788329943.208795:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788329943.208795:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788329943.208796:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788329943.208796:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788329943.208797:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788329943.208813:0:6674:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788329943.208824:0:6674:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315904:0@lo:253: 00000100:00100000:3.0:1788329943.208866:0:6674:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.208891:0:6674:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a2ed240 going to sleep for 11 seconds 00000100:00100000:2.0:1788329943.209089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750315904 00000100:00100000:2.0:1788329943.209095:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750315904 00000100:00100000:2.0:1788329943.209124:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788329943.209131:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6674:x1875199750315904:12345-0@lo:253: 20000000:01000000:2.0:1788329943.209155:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788329943.209169:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788329943.241567:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788329943.241586:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788329943.241606:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788329943.241612:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788329943.241636:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.241655:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa59d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.241664:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.241705:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa59d expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.241719:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa59d expref: 12 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329943.241734:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875199750316032:0@lo:104: 00000100:00100000:1.0:1788329943.241803:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329943.241853:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316032 00000100:00100000:0.0:1788329943.241862:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316032 00000100:00100000:1.0:1788329943.241863:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15300 going to sleep for 11 seconds 00000100:00100000:0.0:1788329943.241913:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788329943.241924:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5860:x1875199750316032:12345-0@lo:104: 00010000:00010000:0.0:1788329943.241936:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.241996:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788329943.242002:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5860:x1875199750316032:12345-0@lo:104: Request processed in 81us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329943.242008:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788329943.242017:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875199750316032:0@lo:104: 00010000:00010000:0.0:1788329943.242029:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788329943.242033:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.242034:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.242061:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468148bc00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788329943.242065:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.242072:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788329943.242080:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329943.242086:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788329943.242128:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.242135:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788329943.242153:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.242160:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468148bc00/0x91094de4de9aa59d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa5a4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329943.242175:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329943.242177:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329943.242179:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329943.242200:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750316160:0@lo:103: 00000100:00100000:0.0:1788329943.242230:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329943.242314:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316160 00000100:00100000:3.0:1788329943.242319:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316160 00010000:00010000:3.0:1788329943.242337:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa59d expref: 13 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329943.242364:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788329943.242371:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750316160:12345-0@lo:103: 00010000:00010000:3.0:1788329943.242381:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329943.242386:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa59d expref: 13 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242396:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa59d expref: 13 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242410:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468148b400/0x91094de4de9aa5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa59d expref: 13 pid: 5838 timeout: 348 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242442:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242449:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788329943.242461:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001456260s 00010000:00010000:3.0:1788329943.242466:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242472:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242479:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242495:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242501:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cce00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788329943.242505:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242512:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242557:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329943.242565:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329943.242605:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a373c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3313:x1875199750316160:12345-0@lo:103: Request processed in 234us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329943.242611:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788329943.242613:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.242620:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329943.242635:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cce00/0x91094de4de9aa637 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329943.243401:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750316160:0@lo:103: 00000100:00100000:1.0:1788329943.251902:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:6674:x1875199750315904:12345-0@lo:253: Request processed in 42758us (43022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329943.251917:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788329943.252005:0:6674:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6674:1875199750315904:0@lo:253: 10000000:01000000:3.0:1788329943.252021:0:6674:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788329943.252024:0:6674:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788329943.252026:0:6674:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788329943.252027:0:6674:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788329943.252028:0:6674:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788329943.252030:0:6674:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788329943.252031:0:6674:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788329943.252032:0:6674:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788329943.252034:0:6674:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788329943.252035:0:6674:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788329943.252037:0:6674:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788329943.252038:0:6674:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788329943.252057:0:6674:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788329943.259438:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329943.259763:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788329943.259981:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329943.260161:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788329943.262776:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329943.263012:0:6674:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788329943.264504:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788329943.518847:0:6674:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788329943.518854:0:6674:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788329943.518903:0:6674:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788329943.518960:0:6674:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788329943.518974:0:6674:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788329943.519002:0:6674:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788329943.648491:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788329944.033302:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788329944.033310:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954689604000 from 21 10000000:01000000:3.0:1788329944.033315:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788329944.033364:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.033388:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.033402:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329944.033431:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316288:0@lo:101: 00000100:00100000:3.0:1788329944.033561:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.033714:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788329944.033838:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316288 00000100:00100000:0.0:1788329944.033852:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316288 00000100:00100000:0.0:1788329944.033910:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788329944.033920:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:5841:x1875199750316288:12345-0@lo:101: 00010000:00010000:0.0:1788329944.033935:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329944.033951:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa63e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.033978:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa63e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.033988:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa63e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.033997:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680030600, rc 0) 00000100:00100000:0.0:1788329944.034047:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750316288:12345-0@lo:101: Request processed in 128us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329944.034053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788329944.034108:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316288:0@lo:101: 00010000:00010000:0.0:1788329944.034125:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.034135:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329944.034200:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316416:0@lo:501: 00000100:00100000:0.0:1788329944.034226:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.034248:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d41300 going to sleep for 11 seconds 00000100:00100000:3.0:1788329944.034588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316416 00000100:00100000:3.0:1788329944.034594:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316416 00000100:00100000:3.0:1788329944.034719:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788329944.034728:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750316416:12345-0@lo:501: 00000100:00100000:3.0:1788329944.035440:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750316416:12345-0@lo:501: Request processed in 709us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.035450:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788329944.036663:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316416:0@lo:501: 00000100:00100000:2.0:1788329944.037117:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316544:0@lo:503: 00000100:00100000:2.0:1788329944.037204:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329944.037252:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788329944.037307:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316544 00000100:00100000:3.0:1788329944.037315:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316544 00000100:00100000:3.0:1788329944.037374:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788329944.037384:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750316544:12345-0@lo:503: 00000100:00100000:3.0:1788329944.037806:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750316544:12345-0@lo:503: Request processed in 423us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.037815:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788329944.037964:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316544:0@lo:503: 00000100:00100000:0.0:1788329944.040442:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6725:1875199750316672:0@lo:502: 00000100:00100000:0.0:1788329944.040580:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.040643:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d41000 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.041050:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316672 00000100:00100000:2.0:1788329944.041059:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316672 00000100:00100000:2.0:1788329944.041116:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788329944.041125:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6725:x1875199750316672:12345-0@lo:502: 00000100:00100000:2.0:1788329944.041404:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6725:x1875199750316672:12345-0@lo:502: Request processed in 280us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.041410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788329944.041675:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6725:1875199750316672:0@lo:502: 00000100:00100000:0.0:1788329944.041744:0:6725:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6725:1875199750316800:0@lo:502: 00000100:00100000:0.0:1788329944.041786:0:6725:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.041827:0:6725:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34300 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.041881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316800 00000100:00100000:2.0:1788329944.041886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316800 00000100:00100000:2.0:1788329944.041921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788329944.041936:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6725:x1875199750316800:12345-0@lo:502: 00000100:00100000:2.0:1788329944.042089:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:6725:x1875199750316800:12345-0@lo:502: Request processed in 153us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.042096:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788329944.042263:0:6725:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6725:1875199750316800:0@lo:502: 00000040:00080000:0.0:1788329944.042285:0:6725:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788329944.047724:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788329944.047774:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788329944.047788:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.047996:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329944.048008:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788329944.048012:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954689604000 from 4 10000000:01000000:3.0:1788329944.048015:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788329944.048067:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.048145:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.048158:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329944.048300:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316928:0@lo:101: 00000100:00100000:3.0:1788329944.048378:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.048432:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78300 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.048433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750316928 00000100:00100000:2.0:1788329944.048446:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750316928 00000100:00100000:3.0:1788329944.048776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788329944.048792:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750316928:12345-0@lo:101: 00010000:00010000:3.0:1788329944.048887:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329944.048905:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa64c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.048929:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa64c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.048937:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa64c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.048952:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468148bc00, rc 0) 00000100:00100000:3.0:1788329944.049028:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750316928:12345-0@lo:101: Request processed in 241us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.049033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788329944.049746:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750316928:0@lo:101: 00010000:00010000:0.0:1788329944.049765:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.049775:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329944.049840:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317056:0@lo:256: 00000100:00100000:0.0:1788329944.049888:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.049924:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34300 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.050102:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317056 00000100:00100000:2.0:1788329944.050108:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317056 00000100:00100000:2.0:1788329944.050151:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788329944.050159:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750317056:12345-0@lo:256: 20000000:01000000:2.0:1788329944.050176:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788329944.050193:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788329944.050197:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788329944.052279:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750317056:12345-0@lo:256: Request processed in 2111us (2381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.052294:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788329944.052402:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317056:0@lo:256: 10000000:01000000:0.0:1788329944.052464:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788329944.052475:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.052495:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329944.052540:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788329944.052543:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1788329944.052547:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788329944.052587:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.052596:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.052605:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329944.052625:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317184:0@lo:101: 00000100:00100000:0.0:1788329944.052659:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.052697:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317184 00000100:00100000:0.0:1788329944.052701:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34300 going to sleep for 11 seconds 00000100:00100000:3.0:1788329944.052705:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317184 00000100:00100000:2.0:1788329944.052774:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788329944.052789:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750317184:12345-0@lo:101: 00010000:00010000:2.0:1788329944.052806:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329944.052821:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa65a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.052843:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa65a expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.052855:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa65a expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.052864:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e200, rc 0) 00000100:00100000:2.0:1788329944.052909:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750317184:12345-0@lo:101: Request processed in 123us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.052917:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788329944.054860:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317184:0@lo:101: 00010000:00010000:0.0:1788329944.054882:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329944.054892:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329944.054950:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317312:0@lo:501: 00000100:00100000:0.0:1788329944.054997:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.055081:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34300 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.060720:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317312 00000100:00100000:2.0:1788329944.060738:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317312 00000100:00100000:2.0:1788329944.060822:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788329944.060834:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750317312:12345-0@lo:501: 00000100:00100000:2.0:1788329944.061197:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750317312:12345-0@lo:501: Request processed in 355us (6188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.061205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788329944.062622:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317312:0@lo:501: 00000100:00100000:1.0:1788329944.062707:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317440:0@lo:503: 00000100:00100000:1.0:1788329944.062784:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329944.062879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317440 00000100:00100000:2.0:1788329944.062887:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317440 00000100:00100000:2.0:1788329944.063040:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788329944.063065:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750317440:12345-0@lo:503: 00000100:00100000:1.0:1788329944.063128:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546aecb2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.067319:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750317440:12345-0@lo:503: Request processed in 4229us (4509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.067335:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788329944.069767:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750317440:0@lo:503: 00000100:00100000:0.0:1788329944.070497:0:6727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6727:1875199750317568:0@lo:502: 00000100:00100000:0.0:1788329944.070982:0:6727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.071072:0:6727:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34540 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.071155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317568 00000100:00100000:2.0:1788329944.071163:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317568 00000100:00100000:2.0:1788329944.071447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788329944.071458:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:6727:x1875199750317568:12345-0@lo:502: 00000100:00100000:2.0:1788329944.072055:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:6727:x1875199750317568:12345-0@lo:502: Request processed in 598us (1073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.072071:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788329944.072240:0:6727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6727:1875199750317568:0@lo:502: 00000020:01000000:0.0:1788329944.072298:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788329944.072315:0:6727:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788329944.072322:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329944.072324:0:6727:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788329944.072330:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788329944.072334:0:6727:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.147@tcp to nid 0x20000c0a8ca93 (192.168.202.147@tcp) 00000020:01000000:0.0:1788329944.072355:0:6727:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788329944.072358:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788329944.072372:0:6727:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff954691403370) 00000020:00000080:0.0:1788329944.072391:0:6727:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1788329944.072397:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788329944.072558:0:6727:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788329944.072574:0:6727:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788329944.072595:0:6727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa66f 00010000:00080000:0.0:1788329944.072657:0:6727:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95469db94000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.147@tcp at head 00010000:00010000:0.0:1788329944.073033:0:6727:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788329944.121004:0:6727:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1788329944.121044:0:6727:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788329944.122946:0:6727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329944.123201:0:6727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788329944.123257:0:6727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1788329944.123320:0:6727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788329944.124048:0:6728:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788329944.124056:0:6728:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788329944.125052:0:6727:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788329944.125069:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788329944.129202:0:6727:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788329944.130272:0:6727:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9aa676 00000100:00080000:0.0:1788329944.130286:0:6727:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788329944.130291:0:6727:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff95469db94000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:0.0:1788329944.130324:0:6727:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546b4bf8700 x1875199750317696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788329944.130353:0:6727:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788329944.130388:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750317696:0@lo:8: 00000100:00100000:0.0:1788329944.130435:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750317952:0@lo:400: 00000100:00100000:3.0:1788329944.130458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.130466:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329944.130545:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750317824:0@lo:400: 00000100:00100000:2.0:1788329944.130583:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329944.130624:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750318080:0@lo:400: 00000100:00100000:3.0:1788329944.130700:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317824 00000100:00100000:3.0:1788329944.130708:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317824 00000100:00100000:3.0:1788329944.130756:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788329944.130766:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:3314:x1875199750317824:12345-0@lo:400: 00000020:01000000:0.0:1788329944.130822:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329944.130829:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329944.130832:0:6727:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788329944.130836:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329944.130840:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329944.130842:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788329944.130844:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788329944.130846:0:6727:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788329944.130871:0:6727:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6727:1875199750318208:0@lo:502: 00000100:00100000:3.0:1788329944.130900:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:3314:x1875199750317824:12345-0@lo:400: Request processed in 135us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.130908:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788329944.130908:0:6727:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.130922:0:6727:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a3ab480 going to sleep for 11 seconds 00000100:00100000:3.0:1788329944.130930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318208 00000100:00100000:3.0:1788329944.130933:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318208 00000100:00100000:3.0:1788329944.130948:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788329944.130954:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:6727:x1875199750318208:12345-0@lo:502: 00000100:00100000:1.0:1788329944.130982:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317696 00000100:00100000:1.0:1788329944.130987:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317696 00000100:00100000:1.0:1788329944.131018:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788329944.131024:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875199750317696:12345-0@lo:8: 00010000:00080000:1.0:1788329944.131044:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:1.0:1788329944.131070:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9aa67d 00002000:00100000:1.0:1788329944.131116:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9545849c2000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788329944.131121:0:6676:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1788329944.131125:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788329944.131245:0:6676:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788329944.131367:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:6727:x1875199750318208:12345-0@lo:502: Request processed in 413us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.131374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00002000:00080000:1.0:1788329944.131385:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788329944.131411:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9545849c0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788329944.131439:0:6727:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6727:1875199750318208:0@lo:502: 00000100:00100000:1.0:1788329944.131455:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875199750317696:12345-0@lo:8: Request processed in 430us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329944.131469:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788329944.131501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750317952 00000100:00100000:1.0:1788329944.131506:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750317952 00000100:00100000:1.0:1788329944.131561:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788329944.131569:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750317952:12345-0@lo:400: 00000100:00100000:1.0:1788329944.131612:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750317952:12345-0@lo:400: Request processed in 44us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329944.131618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788329944.131651:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfb480 x1875199750317952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329944.131663:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750317952:0@lo:400: 00010000:00080000:1.0:1788329944.131690:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bf8700 x1875199750317696/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788329954 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329944.131697:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788329944.131704:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788329944.131711:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788329944.131717:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788329944.131719:0:3311:0:(import.c:65:import_set_state_nolock()) ffff95469db94000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788329944.131726:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788329944.131731:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750317696:0@lo:8: 00000020:01000000:3.0:1788329944.131884:0:6727:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329944.131890:0:6727:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329944.131897:0:6727:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788329944.131902:0:6727:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1788329944.132087:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788329944.132116:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788329944.132127:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132138:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329944.132154:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788329944.132156:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954689604000 from 1 10000000:01000000:1.0:1788329944.132159:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788329944.132184:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132191:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132200:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329944.132214:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318336:0@lo:101: 00000100:00100000:1.0:1788329944.132247:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329944.132272:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546aecb2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788329944.132286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318336 00000100:00100000:1.0:1788329944.132290:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318336 00000100:00100000:1.0:1788329944.132320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788329944.132326:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750318336:12345-0@lo:101: 00010000:00010000:1.0:1788329944.132336:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329944.132348:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa684 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132368:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa684 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132377:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa684 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132397:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc800, rc 0) 00000100:00100000:1.0:1788329944.132428:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750318336:12345-0@lo:101: Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329944.132434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788329944.132464:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318336:0@lo:101: 00010000:00010000:1.0:1788329944.132490:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329944.132500:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329944.132565:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318464:0@lo:501: 00000100:00100000:1.0:1788329944.132589:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329944.132608:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546aecb2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788329944.132619:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318464 00000100:00100000:1.0:1788329944.132622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318464 00000100:00100000:1.0:1788329944.132639:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788329944.132644:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750318464:12345-0@lo:501: 00000100:00100000:1.0:1788329944.132873:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750318464:12345-0@lo:501: Request processed in 227us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329944.132880:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788329944.132908:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318464:0@lo:501: 00000100:00100000:1.0:1788329944.132932:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318592:0@lo:503: 00000100:00100000:1.0:1788329944.132965:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329944.132979:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546aecb2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788329944.132994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318592 00000100:00100000:1.0:1788329944.132997:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318592 00000100:00100000:1.0:1788329944.133014:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788329944.133020:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750318592:12345-0@lo:503: 00000100:00100000:1.0:1788329944.133289:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750318592:12345-0@lo:503: Request processed in 269us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329944.133296:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788329944.133332:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318592:0@lo:503: 00000004:00080000:0.0:1788329944.134731:0:6728:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788329944.134891:0:6728:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 199047372299ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788329944.135619:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750317824:0@lo:400: 00000100:00100000:2.0:1788329944.135666:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329944.135738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318080 00000100:00100000:2.0:1788329944.135745:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318080 00000100:00100000:2.0:1788329944.135798:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329944.135807:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750318080:12345-0@lo:400: 00000100:00100000:2.0:1788329944.135881:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750318080:12345-0@lo:400: Request processed in 75us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.135888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788329944.135910:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788329944.135933:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bf9c00 x1875199750318080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329944.135944:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750318080:0@lo:400: 00000100:00100000:3.0:1788329944.140581:0:6730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6730:1875199750318720:0@lo:502: 00000100:00100000:3.0:1788329944.140774:0:6730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.140817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318720 00000100:00100000:3.0:1788329944.140828:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318720 00000100:00100000:3.0:1788329944.140884:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788329944.140894:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:6730:x1875199750318720:12345-0@lo:502: 00000100:00100000:3.0:1788329944.141367:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:6730:x1875199750318720:12345-0@lo:502: Request processed in 471us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.141376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788329944.141442:0:6730:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78900 going to sleep for 11 seconds 00000100:00100000:3.0:1788329944.141552:0:6730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6730:1875199750318720:0@lo:502: 00000020:01000000:3.0:1788329944.141675:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329944.141686:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329944.141689:0:6730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788329944.141697:0:6730:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff954689604000 00000020:00000080:3.0:1788329944.141699:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788329944.141725:0:6730:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6730:1875199750318848:0@lo:502: 00000100:00100000:3.0:1788329944.141759:0:6730:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.141785:0:6730:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78900 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.141788:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318848 00000100:00100000:2.0:1788329944.141793:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318848 00000100:00100000:2.0:1788329944.141821:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788329944.141829:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:6730:x1875199750318848:12345-0@lo:502: 00000100:00100000:2.0:1788329944.141941:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:6730:x1875199750318848:12345-0@lo:502: Request processed in 112us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.141948:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788329944.141960:0:6730:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:6730:1875199750318848:0@lo:502: 00000020:01000000:3.0:1788329944.141977:0:6730:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329944.141981:0:6730:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329944.141983:0:6730:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788329944.141986:0:6730:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788329944.142050:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788329944.142280:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788329944.142296:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.142308:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329944.142319:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788329944.142321:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9546b4ba4d28 from 1 10000000:01000000:3.0:1788329944.142324:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788329944.142349:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.142358:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329944.142368:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329944.142382:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318976:0@lo:101: 00000100:00100000:3.0:1788329944.142411:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.142435:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78900 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.144098:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750318976 00000100:00100000:2.0:1788329944.144731:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750318976 00000100:00100000:2.0:1788329944.144787:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788329944.144797:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750318976:12345-0@lo:101: 00010000:00010000:2.0:1788329944.144822:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329944.144843:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa692 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.144871:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa692 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.144884:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa692 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.144893:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fa00, rc 0) 00000100:00100000:2.0:1788329944.144973:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750318976:12345-0@lo:101: Request processed in 177us (2561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.144980:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788329944.147715:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750318976:0@lo:101: 00010000:00010000:2.0:1788329944.147745:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.147759:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329944.147847:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750319104:0@lo:501: 00000100:00100000:2.0:1788329944.147921:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329944.147963:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.147985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319104 00000100:00100000:2.0:1788329944.147990:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319104 00000100:00100000:2.0:1788329944.148026:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788329944.148035:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750319104:12345-0@lo:501: 00000100:00100000:2.0:1788329944.149980:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750319104:12345-0@lo:501: Request processed in 1936us (2049us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788329944.149995:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788329944.150059:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750319104:0@lo:501: 10000000:01000000:2.0:1788329944.150093:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788329944.150113:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329944.150124:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788329944.198034:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788329944.239970:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750319232:0@lo:13: 00000100:00100000:0.0:1788329944.240056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.240157:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319232 00000100:00100000:3.0:1788329944.240164:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319232 00000100:00100000:3.0:1788329944.240243:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329944.240255:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750319232:12345-0@lo:13: 00002000:00000024:3.0:1788329944.240280:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00080000:2.0:1788329944.240408:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788329944.240568:0:6729:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788329944.240605:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319360:0@lo:7: 00000100:00100000:1.0:1788329944.240641:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329944.240664:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b47a50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329944.240700:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319360 00000100:00100000:1.0:1788329944.240704:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319360 00000100:00100000:1.0:1788329944.240732:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788329944.240740:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6729:x1875199750319360:12345-0@lo:7: 00000100:00100000:3.0:1788329944.245336:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750319232:12345-0@lo:13: Request processed in 5074us (5271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329944.245352:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:1.0:1788329944.248071:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1788329944.248080:0:6678:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788329944.248725:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6729:x1875199750319360:12345-0@lo:7: Request processed in 7439us (7537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329944.248737:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788329944.248816:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfd9f100 x1875199750319360/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788329960 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329944.248832:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319360:0@lo:7: 00000004:00080000:1.0:1788329944.248847:0:6729:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788329944.248887:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319488:0@lo:5: 00000100:00100000:1.0:1788329944.248937:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329944.249024:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980480 going to sleep for 11 seconds 00010000:00080000:0.0:1788329944.249106:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfd9e680 x1875199750319232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329944.249122:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750319232:0@lo:13: 00000100:00100000:2.0:1788329944.249336:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319488 00000100:00100000:2.0:1788329944.249345:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319488 00000100:00100000:2.0:1788329944.249423:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788329944.249435:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6729:x1875199750319488:12345-0@lo:5: 00002000:00080000:2.0:1788329944.249462:0:6677:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788329944.249466:0:6677:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788329944.249944:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6729:x1875199750319488:12345-0@lo:5: Request processed in 510us (1005us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788329944.249951:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788329944.250027:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfd9f100 x1875199750319488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788329960 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329944.250049:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319488:0@lo:5: 00000004:00080000:3.0:1788329944.250059:0:6729:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788329944.250090:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319616:0@lo:700: 00000100:00100000:3.0:1788329944.250122:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329944.250159:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329944.250268:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319616 00000100:00100000:0.0:1788329944.250274:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319616 00000100:00100000:0.0:1788329944.250314:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329944.250322:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6729:x1875199750319616:12345-0@lo:700: 00000100:00100000:0.0:1788329944.250351:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1875199750319744:0@lo:700: 00000100:00100000:0.0:1788329944.250394:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.250412:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a3ab480 going to sleep for 11 seconds 00000100:00100000:0.0:1788329944.250430:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319744 00000100:00100000:0.0:1788329944.250433:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319744 00000100:00100000:0.0:1788329944.250457:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329944.250463:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1875199750319744:12345-0@lo:700: 40000000:02000000:0.0:1788329944.279813:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1788329944.284907:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6685:x1875199750319744:12345-0@lo:700: Request processed in 34435us (34503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329944.284922:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788329944.285013:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bf8000 x1875199750319744/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788329960 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329944.285034:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6685:1875199750319744:0@lo:700: 40000000:02000000:1.0:1788329944.285052:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:2.0:1788329944.390880:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6729:x1875199750319616:12345-0@lo:700: Request processed in 140549us (140748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329944.390915:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:0.0:1788329944.391792:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788329944.391807:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:3.0:1788329944.398366:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfdb0380 x1875199750319616/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788329960 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329944.398389:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319616:0@lo:700: 00000004:02000040:0.0:1788329944.478511:0:6729:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1788329944.488432:0:6729:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319872:0@lo:5: 00000100:00100000:0.0:1788329944.489631:0:6729:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329944.489692:0:6729:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7b240 going to sleep for 11 seconds 00000100:00100000:2.0:1788329944.489754:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750319872 00000100:00100000:2.0:1788329944.489763:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750319872 00000100:00100000:2.0:1788329944.489825:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788329944.489835:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6729:x1875199750319872:12345-0@lo:5: 00002000:00080000:0.0:1788329944.500907:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788329944.500928:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788329944.506054:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6729:x1875199750319872:12345-0@lo:5: Request processed in 16212us (17529us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788329944.506083:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788329944.507916:0:6729:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfb480 x1875199750319872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788329960 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329944.507933:0:6729:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788329944.507952:0:6729:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9546b4bfb480 x1875199750319872/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788329960 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329944.507964:0:6729:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6729:1875199750319872:0@lo:5: 00000004:00080000:1.0:1788329944.507983:0:6729:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788329944.680895:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329945.698220:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329946.719403:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329947.743476:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329948.768917:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329949.347929:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750320000:0@lo:13: 00000100:00100000:0.0:1788329949.348019:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329949.348081:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750320512:0@lo:400: 00000100:00100000:0.0:1788329949.348112:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329949.348139:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788329949.348305:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750320128:0@lo:400: 00000100:00100000:0.0:1788329949.348342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329949.348382:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750320256:0@lo:400: 00000100:00100000:0.0:1788329949.348408:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329949.348441:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788329949.348448:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750320384:0@lo:400: 00000100:00100000:0.0:1788329949.348470:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329949.348537:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320512 00000100:00100000:0.0:1788329949.348547:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320512 00000100:00100000:0.0:1788329949.348621:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329949.348631:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750320512:12345-0@lo:400: 00000100:00100000:0.0:1788329949.348685:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750320512:12345-0@lo:400: Request processed in 55us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329949.348692:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788329949.348717:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320128 00000100:00100000:0.0:1788329949.348721:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320128 00000100:00100000:0.0:1788329949.348744:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788329949.348750:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3314:x1875199750320128:12345-0@lo:400: 00000100:00100000:0.0:1788329949.348778:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3314:x1875199750320128:12345-0@lo:400: Request processed in 28us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329949.348784:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788329949.348808:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320256 00000100:00100000:0.0:1788329949.348812:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320256 00000100:00100000:0.0:1788329949.348832:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320384 00000100:00100000:0.0:1788329949.348835:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320384 00000100:00100000:0.0:1788329949.348849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788329949.348862:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750320256:12345-0@lo:400: 00000100:00100000:0.0:1788329949.348895:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750320256:12345-0@lo:400: Request processed in 34us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329949.348901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788329949.348913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788329949.348918:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750320384:12345-0@lo:400: 00000100:00100000:0.0:1788329949.348942:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750320384:12345-0@lo:400: Request processed in 25us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329949.348948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788329949.349643:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320000 00000100:00100000:2.0:1788329949.349652:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320000 00000100:00100000:2.0:1788329949.349691:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329949.349699:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750320000:12345-0@lo:13: 00002000:00000024:2.0:1788329949.349730:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788329949.349778:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750320000:12345-0@lo:13: Request processed in 80us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329949.349785:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788329949.352943:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788329949.352953:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788329949.353017:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfa680 x1875199750320384/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329949.353040:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750320384:0@lo:400: 00010000:00080000:0.0:1788329949.353055:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfad80 x1875199750320256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329949.353075:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750320256:0@lo:400: 00000100:00100000:0.0:1788329949.353114:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750320128:0@lo:400: 00010000:00080000:0.0:1788329949.353709:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfb800 x1875199750320000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329949.353737:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750320000:0@lo:13: 00010000:00080000:0.0:1788329949.353752:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bf8a80 x1875199750320512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329949.353760:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750320512:0@lo:400: 00000001:00080000:2.0:1788329949.492254:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:02000400:2.0:1788329949.631987:0:7046:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788329949.791454:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329950.820682:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329951.840571:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329952.865899:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329953.888079:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329954.467953:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750320640:0@lo:400: 00000100:00100000:3.0:1788329954.468050:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329954.468126:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788329954.468133:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750321024:0@lo:400: 00000100:00100000:3.0:1788329954.468163:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329954.468205:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750320768:0@lo:400: 00000100:00100000:3.0:1788329954.468236:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329954.468258:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329954.468264:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750320896:0@lo:400: 00000100:00100000:3.0:1788329954.468285:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329954.468319:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320640 00000100:00100000:3.0:1788329954.468335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320640 00000100:00100000:3.0:1788329954.468405:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788329954.468415:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3315:x1875199750320640:12345-0@lo:400: 00000100:00100000:3.0:1788329954.468472:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3315:x1875199750320640:12345-0@lo:400: Request processed in 59us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329954.468479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788329954.468552:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321024 00000100:00100000:3.0:1788329954.468557:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321024 00000100:00100000:3.0:1788329954.468599:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329954.468605:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750321024:12345-0@lo:400: 00000100:00100000:3.0:1788329954.468638:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750321024:12345-0@lo:400: Request processed in 33us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329954.468644:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329954.468661:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320768 00000100:00100000:3.0:1788329954.468665:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320768 00000100:00100000:3.0:1788329954.468688:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750320896 00000100:00100000:3.0:1788329954.468691:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750320896 00000100:00100000:3.0:1788329954.468706:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329954.468712:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750320768:12345-0@lo:400: 00000100:00100000:3.0:1788329954.468744:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750320768:12345-0@lo:400: Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329954.468751:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329954.468762:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788329954.468768:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750320896:12345-0@lo:400: 00000100:00100000:3.0:1788329954.468793:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750320896:12345-0@lo:400: Request processed in 26us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329954.468799:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788329954.468823:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788329954.468833:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788329954.468871:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfdb3b80 x1875199750320896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329954.468887:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750320896:0@lo:400: 00010000:00080000:3.0:1788329954.468899:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfdb0e00 x1875199750320768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329954.468907:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750320768:0@lo:400: 00010000:00080000:3.0:1788329954.468945:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfdb2a00 x1875199750321024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329954.468953:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788329954.468963:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750321024:0@lo:400: 00000100:00100000:3.0:1788329954.468971:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750320640:0@lo:400: 00000100:00100000:3.0:1788329954.469693:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750321152:0@lo:13: 00000100:00100000:3.0:1788329954.469735:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329954.469808:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321152 00000100:00100000:1.0:1788329954.469814:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321152 00000100:00100000:1.0:1788329954.469854:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788329954.469862:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750321152:12345-0@lo:13: 00002000:00000024:1.0:1788329954.469897:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788329954.469944:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750321152:12345-0@lo:13: Request processed in 82us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329954.469951:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788329954.469992:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfd9f100 x1875199750321152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329954.470006:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750321152:0@lo:13: 00010000:00010000:1.0:1788329954.911552:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329955.935781:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329956.961209:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329957.982902:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329959.007658:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329959.583919:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750321280:0@lo:13: 00000100:00100000:1.0:1788329959.583992:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329959.584078:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321280 00000100:00100000:1.0:1788329959.584085:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321280 00000100:00100000:1.0:1788329959.584141:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788329959.584151:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750321280:12345-0@lo:13: 00002000:00000024:1.0:1788329959.584184:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788329959.584227:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750321280:12345-0@lo:13: Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329959.584234:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788329959.584256:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788329959.584286:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfd9f100 x1875199750321280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329959.584304:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750321280:0@lo:13: 00000100:00100000:1.0:1788329959.586196:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750321408:0@lo:400: 00000100:00100000:1.0:1788329959.586257:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329959.586352:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321408 00000100:00100000:0.0:1788329959.586359:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321408 00000100:00100000:0.0:1788329959.586408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788329959.586417:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3313:x1875199750321408:12345-0@lo:400: 00000100:00100000:2.0:1788329959.586543:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750321536:0@lo:400: 00000100:00100000:2.0:1788329959.586574:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329959.586601:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788329959.586607:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750321664:0@lo:400: 00000100:00100000:2.0:1788329959.586641:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329959.586670:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321536 00000100:00100000:2.0:1788329959.586674:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321536 00000100:00100000:2.0:1788329959.586699:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321664 00000100:00100000:2.0:1788329959.586702:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321664 00000100:00100000:2.0:1788329959.586725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788329959.586732:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750321536:12345-0@lo:400: 00000100:00100000:2.0:1788329959.586769:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750321536:12345-0@lo:400: Request processed in 37us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329959.586776:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788329959.586792:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788329959.586799:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750321664:12345-0@lo:400: 00000100:00100000:2.0:1788329959.586835:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750321664:12345-0@lo:400: Request processed in 37us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329959.586842:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788329959.586878:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546beff8700 x1875199750321664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329959.586890:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750321664:0@lo:400: 00010000:00080000:2.0:1788329959.586899:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546beffb800 x1875199750321536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329959.586907:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750321536:0@lo:400: 00000100:00100000:0.0:1788329959.590316:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3313:x1875199750321408:12345-0@lo:400: Request processed in 3890us (4048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329959.590690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788329959.590801:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750321408:0@lo:400: 00000100:00080000:1.0:1788329959.590831:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788329960.033569:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788329960.980950:0:7612:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788329960.980954:0:7612:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788329960.981109:0:7612:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff954682f55000 00000020:01000004:0.0:1788329960.981127:0:7612:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788329960.981141:0:7612:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788329960.981157:0:7612:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9546914019b8) 00000020:00000080:0.0:1788329960.981176:0:7612:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788329961.023890:0:7612:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788329961.025047:0:7612:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:1.0:1788329961.054649:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788329961.057685:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788329961.072249:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788329961.072290:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788329961.072360:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788329961.072386:0:7612:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788329961.074390:0:7612:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788329961.074405:0:7612:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788329961.074417:0:7612:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x91094de4de9aa6a7 00000020:01000004:0.0:1788329961.074425:0:7612:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788329961.074448:0:7612:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.147@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788329961.074451:0:7612:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788329961.074457:0:7612:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788329961.074493:0:7612:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788329961.074498:0:7612:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.147@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788329961.111187:0:7612:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788329961.111226:0:7612:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.147@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788329961.111230:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788329961.111232:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788329961.111233:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329961.111234:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329961.111235:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329961.111240:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329961.111242:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329961.111243:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329961.111244:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329961.111246:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329961.111247:0:7612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788329961.111250:0:7612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788329961.111253:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788329961.111254:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788329961.111255:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329961.111256:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329961.111257:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329961.111258:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329961.111259:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329961.111260:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329961.111261:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329961.111262:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329961.111263:0:7612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788329961.111288:0:7612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788329961.111306:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750321792:0@lo:253: 00000100:00100000:1.0:1788329961.111388:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.111513:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546835713c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.112293:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321792 00000100:00100000:3.0:1788329961.112303:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321792 00000100:00100000:3.0:1788329961.112370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788329961.112380:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:7612:x1875199750321792:12345-0@lo:253: 20000000:01000000:3.0:1788329961.112414:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788329961.112418:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1788329961.112423:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1788329961.112426:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788329961.113719:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788329961.113949:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788329961.113963:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788329961.114001:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788329961.114009:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788329961.114111:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788329961.114160:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788329961.114702:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788329961.114723:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.147@tcp 20000000:01000000:3.0:1788329961.114726:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.147@tcp (null) (null) (null) 00000040:00080000:3.0:1788329961.114761:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788329961.114771:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788329961.114833:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788329961.114842:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.147@tcp (null) (null) 00000040:00080000:3.0:1788329961.114874:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788329961.114884:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788329961.114914:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788329961.114961:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788329961.116029:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788329961.116055:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.147@tcp 20000000:01000000:2.0:1788329961.116058:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.147@tcp (null) (null) (null) 00000040:00080000:2.0:1788329961.116094:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788329961.116103:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788329961.116131:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788329961.116139:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.147@tcp (null) (null) 00000040:00080000:2.0:1788329961.116166:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788329961.116175:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788329961.116221:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788329961.116258:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788329961.116275:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788329961.116279:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788329961.116286:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788329961.116288:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788329961.116290:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788329961.116304:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788329961.116307:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788329961.116351:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788329961.116363:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788329961.116916:0:7614:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788329961.117227:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788329961.117269:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788329961.117341:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788329961.117353:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788329961.117356:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788329961.117983:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788329961.118106:0:7615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788329961.118162:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788329961.118403:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788329961.118442:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788329961.118497:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788329961.118513:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788329961.118542:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788329961.119194:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788329961.119281:0:7616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788329961.119325:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788329961.119611:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788329961.119654:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788329961.119705:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788329961.119719:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788329961.119721:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788329961.120246:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788329961.120294:0:7617:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788329961.120366:0:7617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788329961.120678:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1788329961.120718:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1788329961.120750:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:0.0:1788329961.120767:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788329961.120789:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120808:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120816:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa614 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120824:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa63e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120830:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa65a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120837:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa692 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120854:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120896:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa692 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.120911:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa692 expref: 16 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.120925:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750321920:0@lo:104: 00000100:00100000:0.0:1788329961.120989:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788329961.121135:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa65a expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.121144:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa65a expref: 16 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.121152:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322048:0@lo:104: 00010000:00010000:0.0:1788329961.121177:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa63e expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.121184:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa63e expref: 16 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.121191:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322176:0@lo:104: 00010000:00010000:0.0:1788329961.121213:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa614 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.121222:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa614 expref: 16 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.121237:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322304:0@lo:104: 00010000:00010000:0.0:1788329961.121263:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.121270:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 16 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.121277:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322432:0@lo:104: 00000100:00100000:0.0:1788329961.121292:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4300 going to sleep for 11 seconds 00000100:00100000:1.0:1788329961.124645:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788329961.124690:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.124727:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.124738:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.124747:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.124759:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750321920 00000100:00100000:1.0:1788329961.124768:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750321920 00000100:00100000:1.0:1788329961.124801:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322048 00000100:00100000:1.0:1788329961.124804:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322048 00000100:00100000:1.0:1788329961.124812:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322176 00000100:00100000:1.0:1788329961.124815:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322176 00000100:00100000:1.0:1788329961.124822:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322304 00000100:00100000:1.0:1788329961.124824:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322304 00000100:00100000:1.0:1788329961.124832:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322432 00000100:00100000:1.0:1788329961.124846:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322432 00000100:00100000:1.0:1788329961.124875:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788329961.124884:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+7:5837:x1875199750321920:12345-0@lo:104: 00010000:00010000:1.0:1788329961.124901:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126153:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329961.126166:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682fc4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+7:5837:x1875199750321920:12345-0@lo:104: Request processed in 1281us (5174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.126176:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788329961.126231:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788329961.126241:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:5837:x1875199750322048:12345-0@lo:104: 00010000:00010000:1.0:1788329961.126253:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126310:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788329961.126325:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:5837:x1875199750322048:12345-0@lo:104: Request processed in 77us (1627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.126331:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788329961.126345:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788329961.126351:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:5837:x1875199750322176:12345-0@lo:104: 00010000:00010000:1.0:1788329961.126359:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126387:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788329961.126392:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:5837:x1875199750322176:12345-0@lo:104: Request processed in 42us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.126397:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788329961.126421:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788329961.126427:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:5837:x1875199750322304:12345-0@lo:104: 00010000:00010000:1.0:1788329961.126435:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126462:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788329961.126467:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:5837:x1875199750322304:12345-0@lo:104: Request processed in 41us (1728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.126473:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788329961.126485:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788329961.126491:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5837:x1875199750322432:12345-0@lo:104: 00010000:00010000:1.0:1788329961.126499:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126549:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788329961.126554:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5837:x1875199750322432:12345-0@lo:104: Request processed in 63us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.126559:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1788329961.126581:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788329961.126586:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126593:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468148b000 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788329961.126598:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126606:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788329961.126624:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329961.126630:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788329961.126665:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126672:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788329961.126697:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126705:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468148b000/0x91094de4de9aa692 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa699 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126720:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788329961.126724:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126730:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680031800 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788329961.126733:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126740:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788329961.126747:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329961.126753:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788329961.126772:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126778:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788329961.126783:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126789:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680031800/0x91094de4de9aa65a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa661 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126799:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788329961.126802:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126807:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468148ac00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788329961.126810:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126817:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788329961.126823:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329961.126829:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788329961.126839:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126845:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788329961.126858:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126873:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468148ac00/0x91094de4de9aa63e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa645 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126883:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788329961.126886:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126892:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e000 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788329961.126895:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126902:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788329961.126908:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329961.126913:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788329961.126925:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126932:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788329961.126936:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126943:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa61b expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126953:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788329961.126961:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126967:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788329961.126970:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.126977:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788329961.126984:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329961.126990:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788329961.127002:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.127007:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788329961.127010:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127240:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329961.127291:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750322816:0@lo:103: 00000100:00100000:3.0:1788329961.127354:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.127392:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788329961.127398:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750322944:0@lo:103: 00000100:00100000:3.0:1788329961.127419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.127443:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750322560:0@lo:103: 00000100:00100000:3.0:1788329961.127464:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.127479:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750323072:0@lo:103: 00000100:00100000:3.0:1788329961.127498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.127510:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329961.127541:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750322688:0@lo:103: 00000100:00100000:3.0:1788329961.127577:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.127602:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322816 00000100:00100000:3.0:1788329961.127609:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322816 00010000:00010000:3.0:1788329961.127638:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa63e expref: 17 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.127656:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322944 00000100:00100000:3.0:1788329961.127658:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322944 00010000:00010000:3.0:1788329961.127669:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa614 expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.127678:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322560 00000100:00100000:3.0:1788329961.127680:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322560 00010000:00010000:3.0:1788329961.127689:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa692 expref: 19 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.127698:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323072 00000100:00100000:3.0:1788329961.127701:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323072 00010000:00010000:3.0:1788329961.127708:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 20 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.127717:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750322688 00000100:00100000:3.0:1788329961.127719:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750322688 00010000:00010000:3.0:1788329961.127726:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa65a expref: 21 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.127737:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788329961.127744:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+21:3314:x1875199750322816:12345-0@lo:103: 00010000:00010000:3.0:1788329961.127754:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329961.127760:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa63e expref: 21 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127774:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa63e expref: 21 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127793:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329961.127823:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+21:3314:x1875199750322816:12345-0@lo:103: Request processed in 79us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.127831:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788329961.127847:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329961.127853:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3314:x1875199750322944:12345-0@lo:103: 00010000:00010000:3.0:1788329961.127860:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329961.127865:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa614 expref: 20 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127873:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa614 expref: 20 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127882:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329961.127899:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3314:x1875199750322944:12345-0@lo:103: Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.127905:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329961.127915:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788329961.127921:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750322560:12345-0@lo:103: 00010000:00010000:3.0:1788329961.127927:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329961.127932:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa692 expref: 19 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127941:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa692 expref: 19 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.127956:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329961.127981:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750322560:12345-0@lo:103: Request processed in 59us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.127987:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788329961.128001:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788329961.128006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:3312:x1875199750323072:12345-0@lo:103: 00010000:00010000:1.0:1788329961.128186:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa5ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa5f1 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.128203:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329961.128205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329961.128207:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329961.128238:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329961.128244:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128252:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128261:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329961.128285:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:3312:x1875199750323072:12345-0@lo:103: Request processed in 278us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.128291:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788329961.128304:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788329961.128310:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3312:x1875199750322688:12345-0@lo:103: 00010000:00010000:3.0:1788329961.128329:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329961.128334:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa65a expref: 17 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128343:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa65a expref: 17 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128354:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128367:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128381:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128388:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128395:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128401:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128407:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680031c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788329961.128411:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128418:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128427:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.128437:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329961.128459:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3312:x1875199750322688:12345-0@lo:103: Request processed in 149us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.128465:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788329961.128496:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750322688:0@lo:103: 00000100:00100000:3.0:1788329961.128514:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750322560:0@lo:103: 00000100:00100000:3.0:1788329961.128546:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750323072:0@lo:103: 00000100:00100000:3.0:1788329961.128579:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750322944:0@lo:103: 00000100:00100000:3.0:1788329961.128586:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750322816:0@lo:103: 00010000:00010000:2.0:1788329961.130209:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa699 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa692 expref: 16 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.130233:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750321920:0@lo:104: 00010000:00010000:2.0:1788329961.130252:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214e200/0x91094de4de9aa661 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa65a expref: 15 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.130263:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322048:0@lo:104: 00010000:00010000:2.0:1788329961.130274:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680030600/0x91094de4de9aa645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa63e expref: 14 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.130288:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322176:0@lo:104: 00010000:00010000:2.0:1788329961.130297:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa61b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa614 expref: 13 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.130340:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322304:0@lo:104: 00010000:00010000:2.0:1788329961.130361:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680031e00/0x91094de4de9aa5f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa5ea expref: 12 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.130371:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5837:1875199750322432:0@lo:104: 00010000:00010000:2.0:1788329961.130398:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.130408:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.130414:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.130421:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680031c00/0x91094de4de9aa6ae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788329961.130436:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788329961.219110:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:7612:x1875199750321792:12345-0@lo:253: Request processed in 106720us (107711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.219126:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788329961.219244:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750321792:0@lo:253: 10000000:01000000:1.0:1788329961.219261:0:7612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788329961.219265:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788329961.219267:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788329961.219284:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329961.219285:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788329961.219286:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329961.219288:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329961.219289:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329961.219291:0:7612:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788329961.219293:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329961.219294:0:7612:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788329961.219326:0:7612:0:(tgt_mount.c:101:server_register_mount()) register mount ffff954682f55000 from lustre-OST0001 10000000:01000000:1.0:1788329961.219354:0:7612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788329961.219357:0:7612:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788329961.219366:0:7612:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9546b4ba4d28 local copy 10000000:01000000:1.0:1788329961.219370:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788329961.219416:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.219430:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.219441:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329961.219462:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323200:0@lo:101: 00000100:00100000:1.0:1788329961.219507:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.219604:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571840 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.219718:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323200 00000100:00100000:3.0:1788329961.219725:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323200 00000100:00100000:3.0:1788329961.219773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788329961.219784:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+11:7612:x1875199750323200:12345-0@lo:101: 00010000:00010000:3.0:1788329961.219797:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329961.219811:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa6b5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.219839:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa6b5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.219850:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6b5 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.219860:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8400, rc 0) 00000100:00100000:3.0:1788329961.219898:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:7612:x1875199750323200:12345-0@lo:101: Request processed in 116us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.219904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788329961.220016:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323200:0@lo:101: 00010000:00010000:1.0:1788329961.220029:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.220037:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329961.220131:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323328:0@lo:501: 00000100:00100000:1.0:1788329961.220164:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.220185:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571840 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.220238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323328 00000100:00100000:3.0:1788329961.220248:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323328 00000100:00100000:3.0:1788329961.220282:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788329961.220289:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:7612:x1875199750323328:12345-0@lo:501: 00000100:00100000:3.0:1788329961.220513:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:7612:x1875199750323328:12345-0@lo:501: Request processed in 223us (346us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788329961.220544:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788329961.220616:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323328:0@lo:501: 10000000:01000000:2.0:1788329961.220629:0:7612:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788329961.220655:0:7612:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788329961.220660:0:7612:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220669:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220676:0:7612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220699:0:7612:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788329961.220735:0:7612:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff954682f55000 10000000:01000000:2.0:1788329961.220740:0:7612:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788329961.220745:0:7612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788329961.220747:0:7612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788329961.220751:0:7612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788329961.220754:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788329961.220771:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220778:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220787:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.220799:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323456:0@lo:101: 00000100:00100000:2.0:1788329961.220825:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329961.220849:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788329961.220862:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323456 00000100:00100000:2.0:1788329961.220867:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323456 00000100:00100000:2.0:1788329961.220889:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788329961.220896:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:7612:x1875199750323456:12345-0@lo:101: 00010000:00010000:2.0:1788329961.220904:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329961.220912:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa6c3 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220927:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220937:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.220950:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fa00, rc 0) 00000100:00100000:2.0:1788329961.220977:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323456:12345-0@lo:101: Request processed in 81us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329961.220983:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788329961.221011:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323456:0@lo:101: 00010000:00010000:2.0:1788329961.221021:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329961.221029:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329961.221079:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323584:0@lo:501: 00000100:00100000:2.0:1788329961.221104:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329961.221117:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788329961.221130:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323584 00000100:00100000:2.0:1788329961.221133:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323584 00000100:00100000:2.0:1788329961.221149:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788329961.221154:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323584:12345-0@lo:501: 00000100:00100000:2.0:1788329961.221297:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323584:12345-0@lo:501: Request processed in 141us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329961.221304:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788329961.221346:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323584:0@lo:501: 00000100:00100000:2.0:1788329961.221370:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323712:0@lo:503: 00000100:00100000:2.0:1788329961.221405:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329961.221419:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788329961.221436:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323712 00000100:00100000:2.0:1788329961.221440:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323712 00000100:00100000:2.0:1788329961.221456:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788329961.221462:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323712:12345-0@lo:503: 00000100:00100000:2.0:1788329961.221625:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323712:12345-0@lo:503: Request processed in 162us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329961.221632:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788329961.221669:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323712:0@lo:503: 00000040:00080000:2.0:1788329961.221953:0:7612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788329961.222015:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323840:0@lo:502: 00000100:00100000:2.0:1788329961.222047:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329961.222069:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788329961.222083:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323840 00000100:00100000:2.0:1788329961.222087:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323840 00000100:00100000:2.0:1788329961.222106:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788329961.222112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323840:12345-0@lo:502: 00000100:00100000:2.0:1788329961.222229:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323840:12345-0@lo:502: Request processed in 116us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329961.222235:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788329961.222270:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323840:0@lo:502: 00000040:00080000:2.0:1788329961.222505:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788329961.222576:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788329961.222613:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788329961.222659:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788329961.222696:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788329961.222728:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788329961.222748:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323968:0@lo:502: 00000100:00100000:2.0:1788329961.222786:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329961.222808:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788329961.222822:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750323968 00000100:00100000:2.0:1788329961.222826:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750323968 00000100:00100000:2.0:1788329961.222845:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788329961.222850:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323968:12345-0@lo:502: 00000100:00100000:2.0:1788329961.222960:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750323968:12345-0@lo:502: Request processed in 109us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329961.222967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788329961.223005:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750323968:0@lo:502: 00000040:00080000:2.0:1788329961.223075:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788329961.223085:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788329961.223368:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788329961.223376:0:7620:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788329961.223382:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329961.223384:0:7620:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788329961.223389:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788329961.223403:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff95458530cd28) 00000020:00000080:2.0:1788329961.223423:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788329961.223429:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788329961.223486:0:7620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff954682f55000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788329961.223493:0:7620:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788329961.223499:0:7620:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x91094de4de9aa6d8 00010000:00010000:3.0:1788329961.224391:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329961.224401:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.224411:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329961.224416:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.224425:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329961.224433:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329961.224439:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329961.224470:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.224476:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329961.224502:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.224509:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa6b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x91094de4de9aa6bc expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.224560:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329961.224561:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329961.224563:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329961.224580:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750324096:0@lo:103: 00000100:00100000:3.0:1788329961.224635:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.224690:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324096 00000100:00100000:3.0:1788329961.224696:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324096 00000100:00100000:3.0:1788329961.224734:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329961.224742:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750324096:12345-0@lo:103: 00010000:00010000:3.0:1788329961.224752:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329961.224767:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa6b5 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.224782:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329961.224812:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3313:x1875199750324096:12345-0@lo:103: Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.224820:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788329961.224855:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750324096:0@lo:103: 00010000:00010000:2.0:1788329961.232033:0:7620:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788329961.232371:0:7620:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1788329961.236455:0:7620:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788329961.236950:0:7620:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788329961.241155:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788329961.241718:0:7620:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788329961.243367:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788329961.243379:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329961.243386:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329961.243388:0:7620:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788329961.243392:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329961.243395:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329961.243397:0:7620:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788329961.243400:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788329961.243402:0:7620:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788329961.243462:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329961.243466:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329961.243467:0:7620:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788329961.243471:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788329961.243659:0:7612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788329961.243685:0:7612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788329961.243708:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.243720:0:7612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329961.243729:0:7612:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954682f55000 from 1 10000000:01000000:0.0:1788329961.243732:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788329961.243772:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.243782:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.243794:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.243818:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324224:0@lo:101: 00000100:00100000:0.0:1788329961.243904:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329961.243953:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788329961.244123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324224 00000100:00100000:1.0:1788329961.244131:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324224 00000100:00100000:1.0:1788329961.244181:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788329961.244191:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:7612:x1875199750324224:12345-0@lo:101: 00010000:00010000:1.0:1788329961.244203:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329961.244216:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa6df expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.244240:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa6df expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.244253:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6df expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.244263:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cdc00, rc 0) 00000100:00100000:1.0:1788329961.244325:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324224:12345-0@lo:101: Request processed in 125us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.244334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788329961.244423:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324224:0@lo:101: 00010000:00010000:0.0:1788329961.244439:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.244449:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329961.244585:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324352:0@lo:501: 00000100:00100000:0.0:1788329961.244612:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329961.244624:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.244692:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324352 00000100:00100000:3.0:1788329961.244696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324352 00000100:00100000:3.0:1788329961.244733:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788329961.244741:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324352:12345-0@lo:501: 00000100:00100000:3.0:1788329961.244962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324352:12345-0@lo:501: Request processed in 221us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.244969:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788329961.244994:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324352:0@lo:501: 00000100:00100000:3.0:1788329961.245093:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324480:0@lo:503: 00000100:00100000:3.0:1788329961.245130:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.245139:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.245155:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324480 00000100:00100000:3.0:1788329961.245159:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324480 00000100:00100000:3.0:1788329961.245175:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788329961.245180:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324480:12345-0@lo:503: 00000100:00100000:3.0:1788329961.245472:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324480:12345-0@lo:503: Request processed in 290us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.245479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788329961.245508:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324480:0@lo:503: 00000040:00080000:3.0:1788329961.245771:0:7612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788329961.245822:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324608:0@lo:502: 00000100:00100000:3.0:1788329961.245859:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.245868:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.245896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324608 00000100:00100000:3.0:1788329961.245900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324608 00000100:00100000:3.0:1788329961.245919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788329961.245926:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324608:12345-0@lo:502: 00000100:00100000:3.0:1788329961.248257:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324608:12345-0@lo:502: Request processed in 2323us (2390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.248271:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788329961.248431:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324608:0@lo:502: 00000040:00080000:1.0:1788329961.248766:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788329961.248827:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788329961.248867:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324736:0@lo:502: 00000100:00100000:1.0:1788329961.248916:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.248959:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546835719c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.249117:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324736 00000100:00100000:3.0:1788329961.249124:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324736 00000100:00100000:3.0:1788329961.249158:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788329961.249167:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324736:12345-0@lo:502: 00000100:00100000:3.0:1788329961.249347:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324736:12345-0@lo:502: Request processed in 179us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.249355:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788329961.249399:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324736:0@lo:502: 00000040:00080000:3.0:1788329961.249479:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788329961.249488:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788329961.249801:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329961.249809:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329961.249812:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788329961.249819:0:7623:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff954682f55000 00000020:00000080:3.0:1788329961.249822:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788329961.249839:0:7623:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329961.249842:0:7623:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329961.249844:0:7623:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788329961.249846:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788329961.249874:0:7612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788329961.249894:0:7612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788329961.249907:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.249926:0:7612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329961.249965:0:7612:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788329961.249968:0:7612:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff954682f55000 10000000:01000000:3.0:1788329961.249971:0:7612:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff954682f55000 10000000:01000000:3.0:1788329961.249975:0:7612:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788329961.249980:0:7612:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954682f55000 from 1 10000000:01000000:3.0:1788329961.249983:0:7612:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788329961.250010:0:7612:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.251261:0:7612:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.251275:0:7612:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.251300:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324864:0@lo:101: 00000100:00100000:3.0:1788329961.251373:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.251459:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329961.259193:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324864 00000100:00100000:0.0:1788329961.259210:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324864 00000100:00100000:0.0:1788329961.259283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788329961.259295:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750324864:12345-0@lo:101: 00010000:00010000:0.0:1788329961.259312:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329961.259343:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa6ed expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.259370:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.259382:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.259391:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680030000, rc 0) 00000100:00100000:0.0:1788329961.259473:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750324864:12345-0@lo:101: Request processed in 180us (8100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329961.259487:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788329961.259883:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324864:0@lo:101: 00010000:00010000:3.0:1788329961.259902:0:7612:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329961.259913:0:7612:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.260115:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324992:0@lo:501: 00000100:00100000:3.0:1788329961.260151:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.260298:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329961.261096:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750324992 00000100:00100000:0.0:1788329961.261104:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750324992 00000100:00100000:1.0:1788329961.261253:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788329961.261262:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750324992:12345-0@lo:501: 00000100:00100000:1.0:1788329961.261564:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750324992:12345-0@lo:501: Request processed in 301us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.261571:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788329961.261703:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750324992:0@lo:501: 00000100:00100000:3.0:1788329961.261735:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750325120:0@lo:503: 00000100:00100000:3.0:1788329961.261772:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.261928:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329961.261987:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325120 00000100:00100000:0.0:1788329961.261991:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325120 00000100:00100000:0.0:1788329961.262023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788329961.262030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750325120:12345-0@lo:503: 00000100:00100000:0.0:1788329961.262176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750325120:12345-0@lo:503: Request processed in 144us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329961.262183:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788329961.262258:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750325120:0@lo:503: 00000040:00080000:3.0:1788329961.262508:0:7612:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788329961.262583:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750325248:0@lo:502: 00000100:00100000:3.0:1788329961.262615:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.262638:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329961.262746:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325248 00000100:00100000:0.0:1788329961.262750:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325248 00000100:00100000:0.0:1788329961.262769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788329961.262775:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750325248:12345-0@lo:502: 00000100:00100000:0.0:1788329961.262927:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750325248:12345-0@lo:502: Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329961.262934:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788329961.263005:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750325248:0@lo:502: 00000040:00080000:3.0:1788329961.263258:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788329961.263305:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788329961.263352:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788329961.263406:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788329961.263443:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788329961.263486:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788329961.263557:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788329961.263594:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788329961.263638:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788329961.263669:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788329961.263699:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788329961.263761:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788329961.263797:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788329961.263836:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788329961.263879:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788329961.263914:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788329961.263944:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788329961.263985:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788329961.264017:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788329961.264050:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788329961.264093:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788329961.264125:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788329961.264154:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788329961.264198:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788329961.264234:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788329961.264268:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788329961.264324:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788329961.264374:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788329961.264403:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788329961.264449:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788329961.264479:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788329961.264510:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788329961.264573:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788329961.264631:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788329961.264666:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788329961.264708:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788329961.264742:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788329961.264779:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750325376:0@lo:502: 00000100:00100000:3.0:1788329961.264849:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.264882:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329961.265054:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325376 00000100:00100000:0.0:1788329961.265061:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325376 00000100:00100000:0.0:1788329961.265093:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788329961.265101:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750325376:12345-0@lo:502: 00000100:00100000:0.0:1788329961.265322:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750325376:12345-0@lo:502: Request processed in 211us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329961.265330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788329961.265496:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750325376:0@lo:502: 00000040:00080000:3.0:1788329961.265653:0:7612:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788329961.265664:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788329961.266296:0:7625:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788329961.266334:0:7625:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff954585053370) 00000020:00000080:3.0:1788329961.266358:0:7625:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1788329961.266437:0:7625:0:(tgt_mount.c:153:server_get_mount()) get mount ffff954682f55000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788329961.266441:0:7625:0:(tgt_mount.c:187:server_put_mount()) put mount ffff954682f55000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788329961.266444:0:7625:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954682f55000 3 00010000:00080000:3.0:1788329961.266472:0:7625:0:(ldlm_lib.c:102:import_set_conn()) imp ffff954698386000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788329961.268395:0:7625:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1788329961.268838:0:7625:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788329961.268874:0:7625:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788329961.268889:0:7625:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x91094de4de9aa702 00000100:00080000:3.0:1788329961.268899:0:7625:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788329961.268905:0:7625:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff954698386000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788329961.268940:0:7625:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546bfdb0a80 x1875199750325504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788329961.268971:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750325504:0@lo:38: 00000100:00100000:3.0:1788329961.269046:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788329961.269100:0:7625:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788329961.269183:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750325632:0@lo:400: 00000100:00100000:3.0:1788329961.269216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.269236:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788329961.269242:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750325760:0@lo:400: 00000100:00100000:3.0:1788329961.269259:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.269282:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750325888:0@lo:400: 00000100:00100000:3.0:1788329961.269304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329961.269347:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325504 00000100:00100000:3.0:1788329961.269353:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325504 00000100:00100000:3.0:1788329961.269370:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325632 00000100:00100000:3.0:1788329961.269372:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325632 00000100:00100000:3.0:1788329961.269396:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325760 00000100:00100000:3.0:1788329961.269398:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325760 00000100:00100000:3.0:1788329961.269424:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788329961.269434:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750325632:12345-0@lo:400: 00000100:00100000:3.0:1788329961.269480:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750325632:12345-0@lo:400: Request processed in 48us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.269488:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788329961.269501:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788329961.269507:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750325760:12345-0@lo:400: 00000100:00100000:3.0:1788329961.269558:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750325760:12345-0@lo:400: Request processed in 51us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.269563:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788329961.269576:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788329961.269579:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875199750325504:12345-0@lo:38: 00010000:00080000:3.0:1788329961.269598:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:3.0:1788329961.269626:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x91094de4de9aa709 00000004:00100000:3.0:1788329961.269644:0:5844:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788329961.269673:0:5844:0:(import.c:65:import_set_state_nolock()) ffff954698385800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788329961.269709:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875199750325504:12345-0@lo:38: Request processed in 128us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.269716:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788329961.269738:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750325888 00000100:00100000:3.0:1788329961.269741:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750325888 00000100:00100000:3.0:1788329961.269768:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788329961.269774:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750325888:12345-0@lo:400: 00000100:00100000:3.0:1788329961.269806:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750325888:12345-0@lo:400: Request processed in 33us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.269821:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788329961.269836:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788329961.269840:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788329961.269866:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff954584b2ed80 x1875199750325888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329961.269879:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750325888:0@lo:400: 00010000:00080000:3.0:1788329961.269902:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff954584b2d880 x1875199750325760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329961.269910:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750325760:0@lo:400: 00010000:00080000:3.0:1788329961.269919:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfdb1180 x1875199750325632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329961.269926:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750325632:0@lo:400: 00010000:00080000:3.0:1788329961.269944:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bfdb0a80 x1875199750325504/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788329971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329961.269952:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788329961.269958:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788329961.269965:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788329961.269969:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788329961.269971:0:3311:0:(import.c:65:import_set_state_nolock()) ffff954698386000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788329961.269976:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750325504:0@lo:38: 00000040:00080000:3.0:1788329961.270539:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788329961.270767:0:7626:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1875199750326016:0@lo:901: 00000100:00100000:2.0:1788329961.270809:0:7626:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329961.270837:0:7626:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788329961.270882:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326016 00000100:00100000:3.0:1788329961.270887:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326016 00000100:00100000:3.0:1788329961.270929:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788329961.270944:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1875199750326016:12345-0@lo:901: 00000100:00080000:2.0:1788329961.271089:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788329961.271436:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7626:x1875199750326016:12345-0@lo:901: Request processed in 491us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.271443:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:1.0:1788329961.272164:0:7612:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1788329961.272198:0:7612:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788329961.272222:0:7612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.272234:0:7612:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788329961.272282:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788329961.272284:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788329961.272286:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329961.272287:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329961.272288:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329961.272289:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329961.272291:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329961.272292:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329961.272294:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329961.272296:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329961.272297:0:7612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788329961.272301:0:7612:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788329961.272303:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788329961.272304:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788329961.272305:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329961.272307:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329961.272308:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329961.272309:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329961.272310:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329961.272311:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329961.272311:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329961.272312:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329961.272326:0:7612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788329961.272346:0:7612:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788329961.272365:0:7612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750326144:0@lo:253: 00000100:00100000:1.0:1788329961.272409:0:7612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.272447:0:7612:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571540 going to sleep for 11 seconds 00000100:00100000:1.0:1788329961.272470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326144 00000100:00100000:1.0:1788329961.272475:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326144 00000100:00100000:1.0:1788329961.272509:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788329961.272537:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7612:x1875199750326144:12345-0@lo:253: 20000000:01000000:1.0:1788329961.272561:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788329961.272575:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788329961.273632:0:7626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546beffb800 x1875199750326016/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788329977 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329961.273648:0:7626:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7626:1875199750326016:0@lo:901: 20000000:01000000:0.0:1788329961.299697:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788329961.299722:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788329961.299776:0:5860:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788329961.299781:0:5860:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788329961.299804:0:5860:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.299823:0:5860:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa64c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.299833:0:5860:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.299873:0:5860:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa64c expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.299887:0:5860:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa64c expref: 14 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329961.299902:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875199750326272:0@lo:104: 00000100:00100000:1.0:1788329961.299969:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329961.300101:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326272 00000100:00100000:0.0:1788329961.300125:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326272 00000100:00100000:0.0:1788329961.300174:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788329961.300184:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5860:x1875199750326272:12345-0@lo:104: 00010000:00010000:0.0:1788329961.300196:0:5828:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329961.300245:0:5828:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788329961.300251:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:5860:x1875199750326272:12345-0@lo:104: Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329961.300258:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788329961.300321:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788329961.300345:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5860:1875199750326272:0@lo:104: 00010000:00010000:1.0:1788329961.300372:0:5860:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300389:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788329961.300395:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300403:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468148b400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788329961.300407:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300415:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788329961.300423:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329961.300428:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788329961.300464:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300471:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788329961.300488:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300495:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa64c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa653 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300512:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329961.300514:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329961.300539:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329961.300557:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750326400:0@lo:103: 00000100:00100000:1.0:1788329961.300587:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329961.300632:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326400 00000100:00100000:1.0:1788329961.300636:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326400 00010000:00010000:1.0:1788329961.300653:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa64c expref: 15 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329961.300674:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788329961.300681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:3313:x1875199750326400:12345-0@lo:103: 00010000:00010000:1.0:1788329961.300691:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788329961.300696:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa64c expref: 15 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300706:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa64c expref: 15 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300720:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468148bc00/0x91094de4de9aa653 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa64c expref: 15 pid: 5839 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300732:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300739:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788329961.300751:0:5830:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001456260s 00010000:00010000:1.0:1788329961.300755:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300763:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300779:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300786:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300792:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788329961.300796:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300803:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300816:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300827:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788329961.300856:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a372050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:3313:x1875199750326400:12345-0@lo:103: Request processed in 176us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329961.300863:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788329961.300931:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750326400:0@lo:103: 00010000:00010000:1.0:1788329961.300945:0:5860:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300954:0:5860:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329961.300961:0:5860:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cc600/0x91094de4de9aa710 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5860 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329961.308147:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:7612:x1875199750326144:12345-0@lo:253: Request processed in 35617us (35724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329961.308166:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788329961.308296:0:7612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7612:1875199750326144:0@lo:253: 10000000:01000000:1.0:1788329961.308325:0:7612:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788329961.308330:0:7612:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788329961.308332:0:7612:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788329961.308333:0:7612:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788329961.308335:0:7612:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788329961.308336:0:7612:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788329961.308337:0:7612:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788329961.308339:0:7612:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788329961.308341:0:7612:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788329961.308343:0:7612:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788329961.308344:0:7612:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788329961.308345:0:7612:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788329961.308361:0:7612:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788329961.313748:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788329961.313943:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788329961.314835:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329961.315213:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788329961.315439:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788329961.315750:0:7612:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788329961.316970:0:7612:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788329961.538663:0:7612:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788329961.538673:0:7612:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788329961.538714:0:7612:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788329961.538791:0:7612:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788329961.538814:0:7612:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788329961.538845:0:7612:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788329962.080076:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329963.103333:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329964.127865:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329964.702678:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750326528:0@lo:13: 00000100:00100000:3.0:1788329964.702760:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329964.702913:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326528 00000100:00100000:2.0:1788329964.702921:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326528 00000100:00100000:2.0:1788329964.703330:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788329964.703342:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750326528:12345-0@lo:13: 00002000:00000024:2.0:1788329964.703382:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788329964.703423:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788329964.703474:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750326528:12345-0@lo:13: Request processed in 134us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329964.703481:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788329964.703610:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9c380 x1875199750326528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329964.703633:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750326528:0@lo:13: 00010000:00010000:1.0:1788329965.154610:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329966.178206:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329966.767061:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750326784:0@lo:400: 00000100:00100000:0.0:1788329966.767130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329966.767223:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750326912:0@lo:400: 00000100:00100000:0.0:1788329966.767250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329966.768281:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750326656:0@lo:400: 00000100:00100000:3.0:1788329966.768332:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329966.768366:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750327168:0@lo:400: 00000100:00100000:3.0:1788329966.768390:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329966.768422:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788329966.768428:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750327040:0@lo:400: 00000100:00100000:3.0:1788329966.770353:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329966.770433:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326784 00000100:00100000:3.0:1788329966.770443:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326784 00000100:00100000:3.0:1788329966.770486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326912 00000100:00100000:3.0:1788329966.770490:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326912 00000100:00100000:3.0:1788329966.770514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327168 00000100:00100000:3.0:1788329966.770531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327168 00000100:00100000:3.0:1788329966.770547:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788329966.770556:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750326784:12345-0@lo:400: 00000100:00100000:3.0:1788329966.770615:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750326784:12345-0@lo:400: Request processed in 60us (3483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329966.770622:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788329966.770637:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788329966.770642:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750326912:12345-0@lo:400: 00000100:00100000:3.0:1788329966.770668:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750326912:12345-0@lo:400: Request processed in 26us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329966.770673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788329966.770682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788329966.770687:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750327168:12345-0@lo:400: 00000100:00100000:3.0:1788329966.770710:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750327168:12345-0@lo:400: Request processed in 23us (2319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329966.770715:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788329966.770736:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750326656 00000100:00100000:3.0:1788329966.770739:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750326656 00000100:00100000:3.0:1788329966.770760:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788329966.770766:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3315:x1875199750326656:12345-0@lo:400: 00000100:00100000:3.0:1788329966.770799:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3315:x1875199750326656:12345-0@lo:400: Request processed in 33us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329966.770805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788329966.770840:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327040 00000100:00100000:3.0:1788329966.770843:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327040 00000100:00100000:3.0:1788329966.770867:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788329966.770873:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750327040:12345-0@lo:400: 00000100:00100000:3.0:1788329966.770898:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750327040:12345-0@lo:400: Request processed in 25us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329966.770903:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788329966.770916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788329966.770920:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788329966.770947:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfa680 x1875199750326784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329966.770961:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750326784:0@lo:400: 00010000:00080000:3.0:1788329966.770987:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfb100 x1875199750326912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329966.770996:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750326912:0@lo:400: 00010000:00080000:3.0:1788329966.771010:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf8a80 x1875199750327040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329966.771018:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750327040:0@lo:400: 00000100:00100000:3.0:1788329966.771026:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750326656:0@lo:400: 00010000:00080000:3.0:1788329966.771034:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf9500 x1875199750327168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329982 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329966.771053:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750327168:0@lo:400: 00010000:00010000:0.0:1788329967.200013:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788329967.262661:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788329967.262669:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9546a001c800 from 30 10000000:01000000:0.0:1788329967.262675:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788329967.267835:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.267856:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.267869:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329967.268803:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327296:0@lo:101: 00000100:00100000:0.0:1788329967.269099:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.269192:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546893c9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.275005:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327296 00000100:00100000:3.0:1788329967.275035:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327296 00000100:00100000:3.0:1788329967.275117:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788329967.275128:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750327296:12345-0@lo:101: 00010000:00010000:3.0:1788329967.275146:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329967.275168:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa717 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.275203:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa717 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.275214:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa717 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.275225:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9200, rc 0) 00000100:00100000:3.0:1788329967.275333:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750327296:12345-0@lo:101: Request processed in 206us (6233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.275340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788329967.275414:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327296:0@lo:101: 00010000:00010000:3.0:1788329967.275438:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.275448:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329967.275553:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327424:0@lo:501: 00000100:00100000:3.0:1788329967.275611:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.275641:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a005ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.275659:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327424 00000100:00100000:3.0:1788329967.275663:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327424 00000100:00100000:3.0:1788329967.275688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788329967.275695:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750327424:12345-0@lo:501: 00000100:00100000:3.0:1788329967.281404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750327424:12345-0@lo:501: Request processed in 5698us (5781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.281421:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788329967.284565:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327424:0@lo:501: 00000100:00100000:1.0:1788329967.284644:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327552:0@lo:503: 00000100:00100000:1.0:1788329967.284749:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.284794:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b57300 going to sleep for 11 seconds 00000100:00100000:1.0:1788329967.284819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327552 00000100:00100000:1.0:1788329967.284825:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327552 00000100:00100000:1.0:1788329967.284875:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788329967.284897:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750327552:12345-0@lo:503: 00000100:00100000:1.0:1788329967.285278:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750327552:12345-0@lo:503: Request processed in 382us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329967.285299:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788329967.285353:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327552:0@lo:503: 00000100:00100000:1.0:1788329967.285582:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7911:1875199750327680:0@lo:502: 00000100:00100000:1.0:1788329967.285619:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.285633:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b57e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.288584:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327680 00000100:00100000:3.0:1788329967.288601:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327680 00000100:00100000:3.0:1788329967.288669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788329967.288680:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7911:x1875199750327680:12345-0@lo:502: 00000100:00100000:3.0:1788329967.289230:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7911:x1875199750327680:12345-0@lo:502: Request processed in 551us (3609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.289239:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788329967.289639:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7911:1875199750327680:0@lo:502: 00000100:00100000:1.0:1788329967.289735:0:7911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7911:1875199750327808:0@lo:502: 00000100:00100000:1.0:1788329967.289788:0:7911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.289822:0:7911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b57e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.290019:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327808 00000100:00100000:3.0:1788329967.290026:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327808 00000100:00100000:3.0:1788329967.290072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788329967.290081:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7911:x1875199750327808:12345-0@lo:502: 00000100:00100000:3.0:1788329967.290280:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:7911:x1875199750327808:12345-0@lo:502: Request processed in 200us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.290288:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788329967.291004:0:7911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7911:1875199750327808:0@lo:502: 00000040:00080000:1.0:1788329967.291037:0:7911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788329967.291206:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788329967.291231:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788329967.291244:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.291255:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329967.291276:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788329967.291278:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788329967.291280:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788329967.291312:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.291320:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.291327:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329967.291343:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327936:0@lo:101: 00000100:00100000:0.0:1788329967.291395:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.291435:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546893c9000 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.291869:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750327936 00000100:00100000:3.0:1788329967.291877:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750327936 00000100:00100000:3.0:1788329967.291996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788329967.292007:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750327936:12345-0@lo:101: 00010000:00010000:3.0:1788329967.292033:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329967.292049:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa725 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.292076:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa725 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.292087:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa725 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.292095:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8e00, rc 0) 00000100:00100000:3.0:1788329967.292142:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750327936:12345-0@lo:101: Request processed in 137us (747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.292148:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788329967.292188:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750327936:0@lo:101: 00010000:00010000:3.0:1788329967.292202:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.292211:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329967.292275:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328064:0@lo:501: 00000100:00100000:3.0:1788329967.292303:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.292322:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0ec10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329967.292384:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328064 00000100:00100000:1.0:1788329967.292389:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328064 00000100:00100000:1.0:1788329967.292421:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788329967.292428:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750328064:12345-0@lo:501: 00000100:00100000:1.0:1788329967.295084:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750328064:12345-0@lo:501: Request processed in 2645us (2769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329967.295099:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788329967.296613:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328064:0@lo:501: 00000100:00100000:0.0:1788329967.296680:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328192:0@lo:503: 00000100:00100000:0.0:1788329967.296828:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.296862:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546893c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.297237:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328192 00000100:00100000:3.0:1788329967.297276:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328192 00000100:00100000:3.0:1788329967.297347:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788329967.297359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750328192:12345-0@lo:503: 00000100:00100000:1.0:1788329967.300480:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328192:0@lo:503: 00000100:00100000:1.0:1788329967.300830:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7912:1875199750328320:0@lo:502: 00000100:00100000:3.0:1788329967.301434:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750328192:12345-0@lo:503: Request processed in 2336us (2864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.301449:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788329967.303123:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.303184:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b57f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.304330:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328320 00000100:00100000:3.0:1788329967.304350:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328320 00000100:00100000:3.0:1788329967.304408:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788329967.304419:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:7912:x1875199750328320:12345-0@lo:502: 00000100:00100000:3.0:1788329967.305865:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:7912:x1875199750328320:12345-0@lo:502: Request processed in 1438us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.305879:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788329967.306478:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7912:1875199750328320:0@lo:502: 00000020:01000000:0.0:1788329967.306556:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329967.306566:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329967.306568:0:7912:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788329967.306573:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788329967.306575:0:7912:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788329967.306608:0:7912:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7912:1875199750328448:0@lo:502: 00000100:00100000:0.0:1788329967.306666:0:7912:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.306838:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328448 00000100:00100000:3.0:1788329967.306845:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328448 00000100:00100000:3.0:1788329967.307810:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788329967.307829:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:7912:x1875199750328448:12345-0@lo:502: 00000100:00100000:0.0:1788329967.308311:0:7912:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546893c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.313384:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:7912:x1875199750328448:12345-0@lo:502: Request processed in 5545us (6700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.313404:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788329967.317153:0:7912:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7912:1875199750328448:0@lo:502: 00000020:01000000:0.0:1788329967.317212:0:7912:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329967.317225:0:7912:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329967.317227:0:7912:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788329967.317231:0:7912:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1788329967.323071:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1788329967.323108:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788329967.323120:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323132:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329967.323143:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788329967.323145:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954689604000 from 30 10000000:01000000:3.0:1788329967.323148:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788329967.323200:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323209:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323221:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329967.323245:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328576:0@lo:101: 00000100:00100000:3.0:1788329967.323328:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.323370:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.323395:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328576 00000100:00100000:3.0:1788329967.323404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328576 00000100:00100000:3.0:1788329967.323458:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788329967.323481:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750328576:12345-0@lo:101: 00010000:00010000:3.0:1788329967.323496:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329967.323509:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa733 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323555:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa733 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323567:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa733 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323576:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9e00, rc 0) 00000100:00100000:3.0:1788329967.323618:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750328576:12345-0@lo:101: Request processed in 151us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.323624:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788329967.323682:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328576:0@lo:101: 00010000:00010000:3.0:1788329967.323698:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.323707:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329967.323756:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328704:0@lo:501: 00000100:00100000:3.0:1788329967.323781:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.323795:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.323811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328704 00000100:00100000:3.0:1788329967.323815:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328704 00000100:00100000:3.0:1788329967.323840:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788329967.323847:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750328704:12345-0@lo:501: 00000100:00100000:3.0:1788329967.324752:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750328704:12345-0@lo:501: Request processed in 900us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.324761:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788329967.324803:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328704:0@lo:501: 00000100:00100000:3.0:1788329967.324839:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328832:0@lo:503: 00000100:00100000:3.0:1788329967.324895:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.324913:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.324932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328832 00000100:00100000:3.0:1788329967.324936:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328832 00000100:00100000:3.0:1788329967.324964:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788329967.324972:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750328832:12345-0@lo:503: 00000100:00100000:3.0:1788329967.325192:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750328832:12345-0@lo:503: Request processed in 221us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.325207:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788329967.325245:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750328832:0@lo:503: 00000100:00100000:1.0:1788329967.327020:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7913:1875199750328960:0@lo:502: 00000100:00100000:1.0:1788329967.327113:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.327154:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.327400:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750328960 00000100:00100000:3.0:1788329967.327407:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750328960 00000100:00100000:3.0:1788329967.327461:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788329967.327471:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:7913:x1875199750328960:12345-0@lo:502: 00000100:00100000:3.0:1788329967.327756:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:7913:x1875199750328960:12345-0@lo:502: Request processed in 285us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.327763:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788329967.328005:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7913:1875199750328960:0@lo:502: 00000100:00100000:1.0:1788329967.328066:0:7913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7913:1875199750329088:0@lo:502: 00000100:00100000:1.0:1788329967.328102:0:7913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.328140:0:7913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b570c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788329967.328235:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329088 00000100:00100000:0.0:1788329967.328240:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329088 00000100:00100000:0.0:1788329967.328289:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788329967.328297:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:7913:x1875199750329088:12345-0@lo:502: 00000100:00100000:0.0:1788329967.328446:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:7913:x1875199750329088:12345-0@lo:502: Request processed in 149us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.328452:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788329967.328859:0:7913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7913:1875199750329088:0@lo:502: 00000040:00080000:1.0:1788329967.328895:0:7913:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1788329967.329189:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1788329967.329209:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788329967.329219:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.329231:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329967.329242:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788329967.329244:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954689604000 from 5 10000000:01000000:3.0:1788329967.329247:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788329967.329289:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.329298:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329967.329308:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329967.329335:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329216:0@lo:101: 00000100:00100000:3.0:1788329967.329374:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.329446:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d159c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788329967.333460:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329216 00000100:00100000:0.0:1788329967.333475:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329216 00000100:00100000:0.0:1788329967.334646:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788329967.334665:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750329216:12345-0@lo:101: 00010000:00010000:0.0:1788329967.334683:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329967.334706:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680031e00/0x91094de4de9aa748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa741 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.334748:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680031e00/0x91094de4de9aa748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa741 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.334760:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680031e00/0x91094de4de9aa748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa741 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.334769:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680031e00, rc 0) 00000100:00100000:0.0:1788329967.334878:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750329216:12345-0@lo:101: Request processed in 218us (5501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.334893:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788329967.334990:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329216:0@lo:101: 00010000:00010000:1.0:1788329967.335024:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.335034:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329967.335121:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329344:0@lo:256: 00000100:00100000:1.0:1788329967.335162:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.339491:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.341989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329344 00000100:00100000:3.0:1788329967.342487:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329344 00000100:00100000:3.0:1788329967.342602:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788329967.342613:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750329344:12345-0@lo:256: 20000000:01000000:3.0:1788329967.342641:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788329967.342659:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788329967.342663:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788329967.342807:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750329344:12345-0@lo:256: Request processed in 195us (7643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.342815:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788329967.345616:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329344:0@lo:256: 10000000:01000000:1.0:1788329967.345690:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788329967.345701:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.345713:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329967.345734:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788329967.345736:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788329967.345739:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788329967.345774:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.345783:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.345792:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329967.345811:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329472:0@lo:101: 00000100:00100000:1.0:1788329967.345877:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.346356:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.346412:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329472 00000100:00100000:3.0:1788329967.346421:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329472 00000100:00100000:3.0:1788329967.346474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788329967.346484:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750329472:12345-0@lo:101: 00010000:00010000:3.0:1788329967.346498:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329967.346512:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa74f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.350289:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa74f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.350311:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa74f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.350323:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8600, rc 0) 00000100:00100000:1.0:1788329967.350419:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750329472:12345-0@lo:101: Request processed in 3935us (4540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329967.350427:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788329967.356927:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329472:0@lo:101: 00010000:00010000:2.0:1788329967.356959:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329967.356973:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329967.357058:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329600:0@lo:501: 00000100:00100000:2.0:1788329967.357124:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329967.357173:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181840 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.357805:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329600 00000100:00100000:3.0:1788329967.357816:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329600 00000100:00100000:3.0:1788329967.357868:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788329967.358021:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750329600:12345-0@lo:501: 00000100:00100000:3.0:1788329967.358411:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750329600:12345-0@lo:501: Request processed in 532us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.358431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788329967.358574:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329600:0@lo:501: 00000100:00100000:1.0:1788329967.358626:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329728:0@lo:503: 00000100:00100000:1.0:1788329967.358686:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.358718:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b57300 going to sleep for 11 seconds 00000100:00100000:0.0:1788329967.358775:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329728 00000100:00100000:0.0:1788329967.358782:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329728 00000100:00100000:0.0:1788329967.358819:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788329967.358826:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750329728:12345-0@lo:503: 00000100:00100000:0.0:1788329967.359196:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750329728:12345-0@lo:503: Request processed in 370us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.359204:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788329967.359371:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750329728:0@lo:503: 00000100:00100000:0.0:1788329967.374409:0:7914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7914:1875199750329856:0@lo:502: 00000100:00100000:0.0:1788329967.374510:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.374573:0:7914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b47a53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.374745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329856 00000100:00100000:3.0:1788329967.374753:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329856 00000100:00100000:3.0:1788329967.376019:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788329967.376035:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:7914:x1875199750329856:12345-0@lo:502: 00000100:00100000:3.0:1788329967.376432:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:7914:x1875199750329856:12345-0@lo:502: Request processed in 400us (1920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.376440:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788329967.376751:0:7914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7914:1875199750329856:0@lo:502: 00000020:01000000:1.0:1788329967.376793:0:7914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788329967.376802:0:7914:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788329967.376809:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329967.376811:0:7914:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788329967.376815:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788329967.376819:0:7914:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.147@tcp to nid 0x20000c0a8ca93 (192.168.202.147@tcp) 00000020:01000000:1.0:1788329967.376845:0:7914:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788329967.376848:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788329967.376867:0:7914:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9546b4a899b8) 00000020:00000080:1.0:1788329967.379344:0:7914:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788329967.379374:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788329967.379481:0:7914:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788329967.379487:0:7914:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788329967.379497:0:7914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9aa764 00010000:00080000:1.0:1788329967.379553:0:7914:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9545852f2000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.147@tcp at head 00010000:00010000:1.0:1788329967.379802:0:7914:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788329967.380660:0:7914:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788329967.380678:0:7914:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788329967.386043:0:7914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788329967.386362:0:7914:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788329967.386413:0:7914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788329967.386479:0:7914:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788329967.387183:0:7917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788329967.387188:0:7917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788329967.393447:0:7914:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788329967.393465:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788329967.393499:0:7914:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788329967.393553:0:7914:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9aa76b 00000100:00080000:3.0:1788329967.393565:0:7914:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788329967.393570:0:7914:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9545852f2000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788329967.393605:0:7914:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff954584b2c000 x1875199750329984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788329967.393636:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750329984:0@lo:8: 00000100:00100000:3.0:1788329967.393709:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.393770:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750329984 00000100:00100000:3.0:1788329967.393778:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750329984 00000100:00100000:3.0:1788329967.393820:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788329967.393829:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3311:x1875199750329984:12345-0@lo:8: 00010000:00080000:3.0:1788329967.393858:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:3.0:1788329967.394047:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9aa772 00002000:00100000:3.0:1788329967.394063:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff954698386800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788329967.394067:0:6677:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788329967.394071:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788329967.394204:0:6677:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788329967.394363:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788329967.394392:0:6677:0:(import.c:65:import_set_state_nolock()) ffff954698382800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788329967.394450:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875199750329984:12345-0@lo:8: Request processed in 620us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.394459:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788329967.395325:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2c000 x1875199750329984/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788329977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329967.395338:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788329967.395348:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788329967.395356:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788329967.395361:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788329967.395364:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9545852f2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788329967.395436:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788329967.395442:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750329984:0@lo:8: 00000100:00080000:3.0:1788329967.395472:0:7914:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000004:00080000:1.0:1788329967.395828:0:7917:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788329967.395975:0:7917:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 222308456036ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788329967.403476:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750330112:0@lo:400: 00000100:00100000:3.0:1788329967.403604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.403643:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329967.403650:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750330240:0@lo:400: 00000100:00100000:3.0:1788329967.403674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.403701:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750330368:0@lo:400: 00000100:00100000:3.0:1788329967.403738:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329967.403760:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788329967.403765:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750330496:0@lo:400: 00000100:00100000:3.0:1788329967.403785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.404232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330112 00000100:00100000:0.0:1788329967.404242:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330112 00000100:00100000:0.0:1788329967.404292:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330240 00000100:00100000:0.0:1788329967.404296:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330240 00000100:00100000:0.0:1788329967.404308:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330496 00000100:00100000:0.0:1788329967.404311:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330496 00000100:00100000:0.0:1788329967.404325:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788329967.404334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750330112:12345-0@lo:400: 00000100:00100000:0.0:1788329967.404402:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750330112:12345-0@lo:400: Request processed in 68us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.404410:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788329967.404431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788329967.404437:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750330240:12345-0@lo:400: 00000100:00100000:0.0:1788329967.404465:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750330240:12345-0@lo:400: Request processed in 29us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.404471:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788329967.404482:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788329967.404489:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750330496:12345-0@lo:400: 00000100:00100000:0.0:1788329967.404535:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750330496:12345-0@lo:400: Request processed in 47us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.404540:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788329967.404561:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330368 00000100:00100000:0.0:1788329967.404565:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330368 00000100:00100000:0.0:1788329967.404591:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788329967.404598:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750330368:12345-0@lo:400: 00000100:00100000:0.0:1788329967.404630:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750330368:12345-0@lo:400: Request processed in 32us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.404636:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000000:0.0:1788329967.404734:0:7914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329967.404743:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329967.404745:0:7914:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788329967.404749:0:7914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329967.404754:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329967.404755:0:7914:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788329967.404758:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788329967.404760:0:7914:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788329967.404807:0:7914:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7914:1875199750330624:0@lo:502: 00000100:00100000:0.0:1788329967.404856:0:7914:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788329967.405328:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2dc00 x1875199750330240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329967.405344:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750330240:0@lo:400: 00010000:00080000:3.0:1788329967.405358:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2c000 x1875199750330112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329967.405366:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750330112:0@lo:400: 00010000:00080000:3.0:1788329967.405405:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2df80 x1875199750330496/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329967.405413:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750330496:0@lo:400: 00010000:00080000:3.0:1788329967.405423:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2c380 x1875199750330368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329967.405431:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750330368:0@lo:400: 00000100:00100000:3.0:1788329967.405451:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330624 00000100:00100000:3.0:1788329967.405455:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330624 00000100:00100000:3.0:1788329967.405490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788329967.405498:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:7914:x1875199750330624:12345-0@lo:502: 00000100:00100000:3.0:1788329967.405751:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:7914:x1875199750330624:12345-0@lo:502: Request processed in 253us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329967.405759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788329967.406129:0:7914:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788329967.406149:0:7914:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:7914:1875199750330624:0@lo:502: 00000020:01000000:0.0:1788329967.406184:0:7914:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329967.406191:0:7914:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329967.406193:0:7914:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788329967.406197:0:7914:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1788329967.408166:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788329967.408205:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788329967.408217:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.408240:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329967.408252:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788329967.408254:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9546b4ba4d28 from 1 10000000:01000000:1.0:1788329967.408266:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788329967.408309:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.408318:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329967.408327:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329967.408350:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750330752:0@lo:101: 00000100:00100000:1.0:1788329967.408417:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329967.408471:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b7b57780 going to sleep for 11 seconds 00000100:00100000:0.0:1788329967.409129:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330752 00000100:00100000:0.0:1788329967.409140:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330752 00000100:00100000:0.0:1788329967.409209:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788329967.409222:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750330752:12345-0@lo:101: 00010000:00010000:0.0:1788329967.409238:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329967.409254:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa779 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.409306:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa779 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.409317:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa779 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.409327:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680030600, rc 0) 00000100:00100000:0.0:1788329967.409380:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750330752:12345-0@lo:101: Request processed in 161us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.409386:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788329967.409434:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750330752:0@lo:101: 00010000:00010000:0.0:1788329967.409449:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.409465:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329967.409539:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750330880:0@lo:501: 00000100:00100000:0.0:1788329967.409569:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.409587:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788329967.409647:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750330880 00000100:00100000:1.0:1788329967.409652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750330880 00000100:00100000:1.0:1788329967.409681:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788329967.409689:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750330880:12345-0@lo:501: 00000100:00100000:0.0:1788329967.411865:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750330880:0@lo:501: 10000000:01000000:0.0:1788329967.411990:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788329967.412000:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329967.412075:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329967.412164:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750330880:12345-0@lo:501: Request processed in 2473us (2592us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788329967.412175:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000004:00080000:2.0:1788329967.492490:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788329967.492603:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750331008:0@lo:13: 00000100:00100000:2.0:1788329967.492681:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329967.492754:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331008 00000100:00100000:2.0:1788329967.492764:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331008 00000100:00100000:2.0:1788329967.492825:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329967.492835:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750331008:12345-0@lo:13: 00002000:00000024:2.0:1788329967.492870:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788329967.492932:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750331008:12345-0@lo:13: Request processed in 98us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329967.492939:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788329967.493032:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788329967.493068:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546beff9c00 x1875199750331008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329967.493088:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750331008:0@lo:13: 00000004:00080000:2.0:1788329967.493107:0:7918:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788329967.493127:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331136:0@lo:7: 00000100:00100000:2.0:1788329967.493153:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329967.493177:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331136 00000100:00100000:2.0:1788329967.493181:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331136 00000100:00100000:2.0:1788329967.493207:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329967.493214:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7918:x1875199750331136:12345-0@lo:7: 00000100:00100000:0.0:1788329967.496168:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1810c0 going to sleep for 11 seconds 00002000:00080000:2.0:1788329967.499362:0:6677:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788329967.499385:0:6677:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788329967.499492:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7918:x1875199750331136:12345-0@lo:7: Request processed in 6271us (6331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329967.499503:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788329967.499986:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546beff9c00 x1875199750331136/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788329983 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329967.500003:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331136:0@lo:7: 00000004:00080000:0.0:1788329967.500019:0:7918:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788329967.500065:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331264:0@lo:5: 00000100:00100000:0.0:1788329967.500106:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.500141:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331264 00000100:00100000:0.0:1788329967.500148:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331264 00000100:00100000:0.0:1788329967.500203:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788329967.500213:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7918:x1875199750331264:12345-0@lo:5: 00002000:00080000:0.0:1788329967.500264:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788329967.500268:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788329967.500555:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7918:x1875199750331264:12345-0@lo:5: Request processed in 343us (449us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788329967.500563:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788329967.500606:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4600 going to sleep for 11 seconds 00010000:00080000:0.0:1788329967.500621:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfb480 x1875199750331264/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788329983 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329967.500631:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331264:0@lo:5: 00000004:00080000:0.0:1788329967.500639:0:7918:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788329967.500665:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331392:0@lo:700: 00000100:00100000:0.0:1788329967.500691:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.500707:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788329967.501007:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331392 00000100:00100000:2.0:1788329967.501020:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331392 00000100:00100000:2.0:1788329967.501059:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329967.501067:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7918:x1875199750331392:12345-0@lo:700: 00000100:00100000:2.0:1788329967.501097:0:6685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beffb100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1875199750331520:0@lo:700: 00000100:00100000:2.0:1788329967.501128:0:6685:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329967.501319:0:6685:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181000 going to sleep for 11 seconds 00000100:00100000:0.0:1788329967.504235:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331520 00000100:00100000:0.0:1788329967.504251:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331520 00000100:00100000:2.0:1788329967.508376:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788329967.508400:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1875199750331520:12345-0@lo:700: 40000000:02000000:0.0:1788329967.602458:0:5851:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788329967.617114:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6685:x1875199750331520:12345-0@lo:700: Request processed in 108709us (115970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329967.617135:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788329967.617216:0:6685:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546beffb100 x1875199750331520/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788329983 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329967.617232:0:6685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beffb100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6685:1875199750331520:0@lo:700: 40000000:02000000:0.0:1788329967.617247:0:6685:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1788329967.748760:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788329967.748784:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788329967.750819:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7918:x1875199750331392:12345-0@lo:700: Request processed in 249741us (250114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329967.750845:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788329967.751086:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf9500 x1875199750331392/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788329983 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329967.751112:0:7918:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788329967.751132:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331392:0@lo:700: 00000004:02000040:0.0:1788329967.819066:0:7918:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788329967.824591:0:7918:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331648:0@lo:5: 00000100:00100000:0.0:1788329967.824668:0:7918:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329967.824727:0:7918:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788329967.824810:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331648 00000100:00100000:3.0:1788329967.824834:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331648 00000100:00100000:3.0:1788329967.824917:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329967.824928:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7918:x1875199750331648:12345-0@lo:5: 00002000:00080000:0.0:1788329967.843861:0:6678:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788329967.843882:0:6678:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788329967.855856:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7918:x1875199750331648:12345-0@lo:5: Request processed in 30917us (31175us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788329967.855875:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788329967.864627:0:7918:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf9500 x1875199750331648/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788329983 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329967.864653:0:7918:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7918:1875199750331648:0@lo:5: 00000004:00080000:1.0:1788329967.864669:0:7918:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1788329968.223766:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788329968.254959:0:7977:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788329969.247345:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329969.823246:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788329969.823276:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750331776:0@lo:13: 00000100:00100000:1.0:1788329969.823379:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329969.823540:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331776 00000100:00100000:3.0:1788329969.823550:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331776 00000100:00080000:0.0:1788329969.823596:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788329969.823615:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788329969.823628:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750331776:12345-0@lo:13: 00002000:00000024:3.0:1788329969.823668:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788329969.823728:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750331776:12345-0@lo:13: Request processed in 103us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329969.823735:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788329969.823802:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9e300 x1875199750331776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329969.823821:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750331776:0@lo:13: 00010000:00010000:3.0:1788329970.273192:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788329971.297268:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329972.318661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329972.895338:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750331904:0@lo:13: 00000100:00100000:1.0:1788329972.895353:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750332160:0@lo:400: 00000100:00100000:3.0:1788329972.895431:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329972.895435:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329972.895497:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750332416:0@lo:400: 00000100:00100000:1.0:1788329972.898615:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750332672:0@lo:400: 00000100:00100000:1.0:1788329972.898716:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329972.898770:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788329972.898777:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750332288:0@lo:400: 00000100:00100000:1.0:1788329972.898805:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329972.898841:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332160 00000100:00100000:1.0:1788329972.898850:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332160 00000100:00100000:1.0:1788329972.898897:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332288 00000100:00100000:1.0:1788329972.898900:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332288 00000100:00100000:1.0:1788329972.898927:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788329972.898937:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750332160:12345-0@lo:400: 00000100:00100000:2.0:1788329972.899037:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332672 00000100:00100000:2.0:1788329972.899042:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332672 00000100:00100000:2.0:1788329972.899079:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788329972.899086:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750332672:12345-0@lo:400: 00000100:00100000:2.0:1788329972.899143:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750332672:12345-0@lo:400: Request processed in 58us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329972.899150:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788329972.899189:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9f480 x1875199750332672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329972.899218:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750332672:0@lo:400: 00000100:00100000:1.0:1788329972.901124:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750332160:12345-0@lo:400: Request processed in 2181us (5685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329972.901143:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788329972.901174:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788329972.901185:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750332288:12345-0@lo:400: 00000100:00100000:1.0:1788329972.901234:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750332288:12345-0@lo:400: Request processed in 52us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329972.901240:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788329972.901266:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788329972.901271:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788329972.901605:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750332032:0@lo:400: 00000100:00100000:2.0:1788329972.902023:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329972.902079:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750332544:0@lo:400: 00000100:00100000:2.0:1788329972.902108:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788329972.902403:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9d880 x1875199750332288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329972.902418:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750332288:0@lo:400: 00010000:00080000:1.0:1788329972.902430:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9df80 x1875199750332160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329972.902438:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750332160:0@lo:400: 00000100:00100000:1.0:1788329972.906029:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332544 00000100:00100000:1.0:1788329972.906044:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332544 00000100:00100000:1.0:1788329972.906109:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788329972.906120:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750332544:12345-0@lo:400: 00000100:00100000:1.0:1788329972.906226:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750332544:12345-0@lo:400: Request processed in 108us (4115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329972.906232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788329972.906253:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788329972.907443:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9f100 x1875199750332544/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788329988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329972.907463:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750332544:0@lo:400: 00000100:00100000:3.0:1788329972.907489:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332032 00000100:00100000:3.0:1788329972.907497:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332032 00000100:00100000:3.0:1788329972.908410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788329972.908424:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750332032:12345-0@lo:400: 00000100:00100000:3.0:1788329972.908497:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750332032:12345-0@lo:400: Request processed in 78us (6839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329972.908505:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788329972.908569:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750331904 00000100:00100000:3.0:1788329972.908573:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750331904 00000100:00100000:3.0:1788329972.908604:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329972.908612:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750331904:12345-0@lo:13: 00002000:00000024:3.0:1788329972.908652:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788329972.913785:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750331904:12345-0@lo:13: Request processed in 5162us (18344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329972.913800:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788329972.914431:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329972.914472:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332416 00000100:00100000:3.0:1788329972.914480:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332416 00000100:00100000:3.0:1788329972.914551:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788329972.914560:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750332416:12345-0@lo:400: 00000100:00100000:3.0:1788329972.914611:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750332416:12345-0@lo:400: Request processed in 53us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329972.914618:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788329972.914633:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788329972.914662:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9d180 x1875199750332416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329972.914676:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750332416:0@lo:400: 00010000:00080000:3.0:1788329972.914702:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2c380 x1875199750331904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329972.914719:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750331904:0@lo:13: 00000100:00100000:2.0:1788329972.916482:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750332032:0@lo:400: 00000001:00080000:2.0:1788329973.015922:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:0.0:1788329973.370133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329974.431915:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788329974.943497:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750332800:0@lo:13: 00000100:00100000:2.0:1788329974.943591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329974.944264:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332800 00000100:00100000:1.0:1788329974.944274:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332800 00000100:00100000:1.0:1788329974.944348:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788329974.944367:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750332800:12345-0@lo:13: 00002000:00000024:1.0:1788329974.944403:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788329974.944471:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750332800:12345-0@lo:13: Request processed in 106us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329974.944478:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788329974.944574:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469b7c5180 x1875199750332800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329990 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329974.944593:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750332800:0@lo:13: 00000100:00080000:3.0:1788329974.944659:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788329975.426696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.426862:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729336704 00000100:00100000:1.0:1788329975.426872:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729336704 00000100:00100000:1.0:1788329975.426921:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:1.0:1788329975.426930:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2345:x1875199729336704:12345-192.168.202.47@tcp:250: 00010000:00080000:1.0:1788329975.426961:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from a12fed02-6dfe-42b9-b082-430e8d26c8c5@192.168.202.47@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788329975.426998:0:5837:0:(genops.c:1385:class_connect()) connect: client a12fed02-6dfe-42b9-b082-430e8d26c8c5, cookie 0x91094de4de9aa787 00000100:00080000:1.0:1788329975.427126:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9545852f6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788329975.427208:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+5:2345:x1875199729336704:12345-192.168.202.47@tcp:250: Request processed in 278us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.427216:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:3.0:1788329975.439425:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.441672:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729336576 00000100:00100000:1.0:1788329975.441703:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729336576 00000100:00100000:1.0:1788329975.441802:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:1.0:1788329975.441814:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+5:5577:x1875199729336576:12345-192.168.202.47@tcp:101: 00010000:00010000:1.0:1788329975.441832:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329975.441860:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea22 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.442293:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.442328:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 6 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.442338:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cde00, rc 0) 00000100:00100000:1.0:1788329975.442983:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+6:5577:x1875199729336576:12345-192.168.202.47@tcp:101: Request processed in 1166us (3564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.442994:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:3.0:1788329975.456455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.457539:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729336832 00000100:00100000:1.0:1788329975.457551:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729336832 00000100:00100000:1.0:1788329975.457670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 116 00000100:00100000:1.0:1788329975.457681:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+6:5577:x1875199729336832:12345-192.168.202.47@tcp:501: 00000100:00100000:1.0:1788329975.459598:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+6:5577:x1875199729336832:12345-192.168.202.47@tcp:501: Request processed in 1910us (3149us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788329975.459613:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 116 00000100:00100000:2.0:1788329975.463734:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.463980:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729336960 00000100:00100000:1.0:1788329975.463990:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729336960 00000100:00100000:1.0:1788329975.464075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 117 00000100:00100000:1.0:1788329975.464085:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+6:5577:x1875199729336960:12345-192.168.202.47@tcp:101: 00010000:00010000:0.0:1788329975.464212:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788329975.464266:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329975.464289:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea29 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.464321:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.464333:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.464354:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20ccc00, rc 0) 00000100:00100000:1.0:1788329975.464413:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+7:5577:x1875199729336960:12345-192.168.202.47@tcp:101: Request processed in 330us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.464420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 117 00000100:00100000:2.0:1788329975.467482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.467688:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337088 00000100:00100000:1.0:1788329975.467699:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337088 00000100:00100000:1.0:1788329975.467759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 118 00000100:00100000:1.0:1788329975.467778:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+7:5577:x1875199729337088:12345-192.168.202.47@tcp:501: 00000100:00100000:1.0:1788329975.468483:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5577:x1875199729337088:12345-192.168.202.47@tcp:501: Request processed in 709us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.468492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 118 00000100:00100000:1.0:1788329975.486447:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329975.491047:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337216 00000100:00100000:3.0:1788329975.491073:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337216 00000100:00100000:2.0:1788329975.495502:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:2.0:1788329975.495535:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5577:x1875199729337216:12345-192.168.202.47@tcp:503: 00000100:00100000:2.0:1788329975.497442:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5577:x1875199729337216:12345-192.168.202.47@tcp:503: Request processed in 1916us (10997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329975.497458:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:2.0:1788329975.511545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.511643:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337344 00000100:00100000:1.0:1788329975.511653:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337344 00000100:00100000:1.0:1788329975.511710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 120 00000100:00100000:1.0:1788329975.511724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5595:x1875199729337344:12345-192.168.202.47@tcp:502: 00000100:00100000:1.0:1788329975.512315:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5595:x1875199729337344:12345-192.168.202.47@tcp:502: Request processed in 592us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.512325:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 120 00000100:00100000:1.0:1788329975.561993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329975.562683:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337472 00000100:00100000:2.0:1788329975.562695:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337472 00000100:00100000:2.0:1788329975.562766:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 121 00000100:00100000:2.0:1788329975.562787:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5595:x1875199729337472:12345-192.168.202.47@tcp:502: 00000100:00100000:2.0:1788329975.563969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5595:x1875199729337472:12345-192.168.202.47@tcp:502: Request processed in 332us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329975.563986:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 121 00000100:00100000:2.0:1788329975.570948:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329975.571079:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337600 00000100:00100000:3.0:1788329975.571092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337600 00000100:00100000:3.0:1788329975.571191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 122 00000100:00100000:3.0:1788329975.571203:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5577:x1875199729337600:12345-192.168.202.47@tcp:101: 00010000:00010000:3.0:1788329975.571223:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329975.571241:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9600/0x91094de4de9aa79c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea53 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.571274:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9600/0x91094de4de9aa79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea53 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.571285:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9600/0x91094de4de9aa79c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea53 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329975.571296:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9600, rc 0) 00000100:00100000:3.0:1788329975.571366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5577:x1875199729337600:12345-192.168.202.47@tcp:101: Request processed in 165us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329975.571373:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 122 00000100:00100000:0.0:1788329975.582278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.584682:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337728 00000100:00100000:1.0:1788329975.584700:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337728 00000100:00100000:1.0:1788329975.584783:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 123 00000100:00100000:1.0:1788329975.584794:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5577:x1875199729337728:12345-192.168.202.47@tcp:256: 20000000:01000000:1.0:1788329975.584844:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788329975.584867:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788329975.584872:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788329975.584886:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788329975.584888:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788329975.597400:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5577:x1875199729337728:12345-192.168.202.47@tcp:256: Request processed in 12594us (15121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329975.597417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 123 00000100:00100000:2.0:1788329975.600407:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.600514:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337856 00000100:00100000:1.0:1788329975.600548:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337856 00000100:00100000:1.0:1788329975.600618:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 124 00000100:00100000:1.0:1788329975.600632:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5577:x1875199729337856:12345-192.168.202.47@tcp:101: 00010000:00010000:1.0:1788329975.600653:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329975.600674:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea5a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.600705:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.600716:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329975.600727:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd200, rc 0) 00000100:00100000:1.0:1788329975.600802:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5577:x1875199729337856:12345-192.168.202.47@tcp:101: Request processed in 173us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.600809:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 124 00000100:00100000:0.0:1788329975.609619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329975.610280:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729337984 00000100:00100000:3.0:1788329975.610291:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729337984 00000100:00100000:3.0:1788329975.610350:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 125 00000100:00100000:3.0:1788329975.610370:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5577:x1875199729337984:12345-192.168.202.47@tcp:501: 00000100:00100000:3.0:1788329975.610707:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5577:x1875199729337984:12345-192.168.202.47@tcp:501: Request processed in 346us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329975.610716:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 125 00000100:00100000:2.0:1788329975.626368:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329975.626449:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338112 00000100:00100000:3.0:1788329975.626483:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338112 00000100:00100000:3.0:1788329975.626623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 126 00000100:00100000:3.0:1788329975.626634:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5577:x1875199729338112:12345-192.168.202.47@tcp:503: 00000100:00100000:2.0:1788329975.628068:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5577:x1875199729338112:12345-192.168.202.47@tcp:503: Request processed in 1429us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329975.628080:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 126 00000100:00100000:3.0:1788329975.634668:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.640108:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338240 00000100:00100000:1.0:1788329975.640138:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338240 00000100:00100000:1.0:1788329975.640208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 127 00000100:00100000:1.0:1788329975.640220:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5600:x1875199729338240:12345-192.168.202.47@tcp:502: 00000100:00100000:1.0:1788329975.640559:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5600:x1875199729338240:12345-192.168.202.47@tcp:502: Request processed in 339us (5900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329975.640575:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 127 00000100:00100000:1.0:1788329975.642952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329975.643083:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338368 00000100:00100000:3.0:1788329975.643092:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338368 00000100:00100000:3.0:1788329975.643134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 128 00000100:00100000:3.0:1788329975.643143:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5600:x1875199729338368:12345-192.168.202.47@tcp:502: 00000100:00100000:3.0:1788329975.643398:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5600:x1875199729338368:12345-192.168.202.47@tcp:502: Request processed in 254us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329975.643406:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 128 00000100:00100000:2.0:1788329975.649121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329975.649255:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338496 00000100:00100000:1.0:1788329975.649267:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338496 00000100:00100000:1.0:1788329975.649790:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:1.0:1788329975.649802:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1875199729338496:12345-192.168.202.47@tcp:38: 00010000:00080000:1.0:1788329975.649840:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 230 last 0 00000020:00000080:1.0:1788329975.650024:0:5844:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9aa7aa 00000004:00100000:1.0:1788329975.650056:0:5844:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788329975.650062:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788329975.705609:0:5844:0:(import.c:65:import_set_state_nolock()) ffff954585fd0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788329975.705705:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729338496:12345-192.168.202.47@tcp:38: Request processed in 55902us (56594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329975.705717:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00010000:00010000:2.0:1788329976.478792:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329976.714725:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329976.714774:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329976.714955:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338624 00000100:00100000:0.0:1788329976.714966:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338624 00000100:00100000:0.0:1788329976.715033:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338752 00000100:00100000:0.0:1788329976.715037:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338752 00000100:00100000:0.0:1788329976.715054:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:0.0:1788329976.715081:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:0:x1875199729338624:12345-192.168.202.47@tcp:41: 00000004:00000024:0.0:1788329976.715125:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788329976.715205:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:0:x1875199729338624:12345-192.168.202.47@tcp:41: Request processed in 126us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329976.715212:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:0.0:1788329976.715232:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:0.0:1788329976.715239:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5577:x1875199729338752:12345-192.168.202.47@tcp:41: 00000004:00000024:0.0:1788329976.715249:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788329976.715270:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5577:x1875199729338752:12345-192.168.202.47@tcp:41: Request processed in 32us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329976.715275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00080000:1.0:1788329976.715342:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788329976.721800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329976.722006:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729338880 00000100:00100000:0.0:1788329976.722017:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729338880 00000100:00100000:0.0:1788329976.722083:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:0.0:1788329976.722095:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5577:x1875199729338880:12345-192.168.202.47@tcp:40: 00000100:00100000:0.0:1788329976.722199:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5577:x1875199729338880:12345-192.168.202.47@tcp:40: Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329976.722207:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:2.0:1788329976.731254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329976.731300:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329976.731419:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339008 00000100:00100000:0.0:1788329976.731431:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339008 00000100:00100000:0.0:1788329976.731480:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:0.0:1788329976.731488:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875199729339008:12345-192.168.202.47@tcp:8: 00010000:00080000:0.0:1788329976.731542:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1788329976.731574:0:6676:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9aa7b1 00002000:00100000:0.0:1788329976.731586:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a815e47-382d-4064-91e8-23b9de97ce7e/ffff954682f55800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788329976.731620:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788329976.732220:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788329976.732256:0:6676:0:(import.c:65:import_set_state_nolock()) ffff954682f51800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788329976.732326:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729339008:12345-192.168.202.47@tcp:8: Request processed in 836us (1084us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329976.732335:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:3.0:1788329976.732558:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339264 00000100:00100000:3.0:1788329976.732565:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339264 00000100:00100000:3.0:1788329976.732599:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 129 00000100:00100000:3.0:1788329976.732607:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729339264:12345-192.168.202.47@tcp:400: 00000100:00100000:1.0:1788329976.732894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329976.733417:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788329976.733430:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788329976.734144:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339136 00000100:00100000:0.0:1788329976.734152:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339136 00000100:00100000:0.0:1788329976.734203:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:0.0:1788329976.734211:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875199729339136:12345-192.168.202.47@tcp:8: 00010000:00080000:0.0:1788329976.734241:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 231 last 0 00000020:00000080:0.0:1788329976.734272:0:6676:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9aa7b8 00002000:00100000:0.0:1788329976.734282:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a815e47-382d-4064-91e8-23b9de97ce7e/ffff954682f50800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788329976.734303:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788329976.735974:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788329976.736015:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9546a2733000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788329976.736353:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729339136:12345-192.168.202.47@tcp:8: Request processed in 2138us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329976.736363:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:2.0:1788329976.749310:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329976.751695:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729339264:12345-192.168.202.47@tcp:400: Request processed in 19075us (20380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329976.751708:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 129 00000100:00100000:0.0:1788329976.754060:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339392 00000100:00100000:0.0:1788329976.754077:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339392 00000100:00100000:0.0:1788329976.754142:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:0.0:1788329976.754155:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5577:x1875199729339392:12345-192.168.202.47@tcp:33: 00000004:00080000:3.0:1788329976.775432:0:5847:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 21177us 00000004:00200000:3.0:1788329976.787103:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788329976.787253:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5577:x1875199729339392:12345-192.168.202.47@tcp:33: Request processed in 33094us (37951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329976.787268:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:2.0:1788329976.951729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329976.951847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339520 00000100:00100000:3.0:1788329976.951858:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339520 00000100:00100000:3.0:1788329976.951965:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:3.0:1788329976.951989:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5617:x1875199729339520:12345-192.168.202.47@tcp:101: 00010000:00010000:3.0:1788329976.952011:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329976.955357:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9800/0x91094de4de9aa7bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea84 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329976.955445:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa7c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329976.955459:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329976.955475:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788329976.955511:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788329976.955531:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788329976.955550:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa7c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329976.955578:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9800/0x91094de4de9aa7bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea84 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329976.955601:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa7c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea84 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329976.955610:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cc900) 00010000:00010000:3.0:1788329976.955612:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788329976.955616:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788329976.955750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:5617:x1875199729339520:12345-192.168.202.47@tcp:101: Request processed in 3762us (4033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329976.955777:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00010000:00010000:0.0:1788329977.504550:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329978.015235:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750333184:0@lo:400: 00000100:00100000:3.0:1788329978.015315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329978.015386:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329978.015393:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750333312:0@lo:400: 00000100:00100000:3.0:1788329978.015424:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329978.015584:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750333056:0@lo:400: 00000100:00100000:2.0:1788329978.015617:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329978.015651:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750333568:0@lo:400: 00000100:00100000:2.0:1788329978.015674:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329978.015714:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788329978.015720:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750332928:0@lo:400: 00000100:00100000:2.0:1788329978.015754:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329978.015774:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750333440:0@lo:400: 00000100:00100000:2.0:1788329978.015795:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329978.015825:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333312 00000100:00100000:2.0:1788329978.015833:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333312 00000100:00100000:2.0:1788329978.015912:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333568 00000100:00100000:2.0:1788329978.015916:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333568 00000100:00100000:2.0:1788329978.015942:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788329978.015951:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750333312:12345-0@lo:400: 00000100:00100000:2.0:1788329978.016015:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750333312:12345-0@lo:400: Request processed in 65us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329978.016039:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788329978.016058:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788329978.016065:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750333568:12345-0@lo:400: 00000100:00100000:2.0:1788329978.016097:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750333568:12345-0@lo:400: Request processed in 33us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329978.016103:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788329978.016150:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfdb2a00 x1875199750333568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329978.016171:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788329978.016190:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750333568:0@lo:400: 00000100:00100000:2.0:1788329978.016208:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333184 00000100:00100000:2.0:1788329978.016212:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333184 00000100:00100000:2.0:1788329978.016233:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333056 00000100:00100000:2.0:1788329978.016236:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333056 00000100:00100000:2.0:1788329978.016247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333440 00000100:00100000:2.0:1788329978.016249:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333440 00000100:00100000:2.0:1788329978.016261:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788329978.016267:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750333184:12345-0@lo:400: 00000100:00100000:2.0:1788329978.016298:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750333184:12345-0@lo:400: Request processed in 31us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329978.016304:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788329978.016316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788329978.016321:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750333056:12345-0@lo:400: 00000100:00100000:2.0:1788329978.016350:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750333056:12345-0@lo:400: Request processed in 29us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329978.016355:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788329978.016373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788329978.016379:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750333440:12345-0@lo:400: 00000100:00100000:2.0:1788329978.016408:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750333440:12345-0@lo:400: Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329978.016415:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788329978.016441:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750333440:0@lo:400: 00000100:00100000:2.0:1788329978.016453:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750333056:0@lo:400: 00000100:00080000:2.0:1788329978.016489:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788329978.016494:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788329978.016496:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788329978.016902:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750332928 00000100:00100000:0.0:1788329978.016916:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750332928 00000100:00100000:0.0:1788329978.016954:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788329978.016961:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750332928:12345-0@lo:400: 00000100:00100000:0.0:1788329978.017007:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750332928:12345-0@lo:400: Request processed in 48us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329978.017014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788329978.017494:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750332928:0@lo:400: 00010000:00080000:3.0:1788329978.017608:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2f800 x1875199750333312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329978.017620:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750333312:0@lo:400: 00000100:00100000:3.0:1788329978.017634:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750333184:0@lo:400: 00000100:00100000:3.0:1788329978.017863:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750333696:0@lo:13: 00000100:00100000:3.0:1788329978.018071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329978.018174:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333696 00000100:00100000:0.0:1788329978.018180:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333696 00000100:00100000:0.0:1788329978.018223:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788329978.018231:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750333696:12345-0@lo:13: 00002000:00000024:0.0:1788329978.018248:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788329978.020605:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750333696:12345-0@lo:13: Request processed in 2363us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329978.020621:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1788329978.020775:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469b7c7480 x1875199750333696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329978.020800:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750333696:0@lo:13: 00010000:00010000:2.0:1788329978.528140:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329979.318894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329979.319015:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339648 00000100:00100000:0.0:1788329979.319027:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339648 00000100:00100000:0.0:1788329979.319112:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:0.0:1788329979.319123:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:5669:x1875199729339648:12345-192.168.202.47@tcp:41: 00000004:00000024:0.0:1788329979.319182:0:5844:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788329979.319253:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:5669:x1875199729339648:12345-192.168.202.47@tcp:41: Request processed in 131us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329979.319260:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00080000:1.0:1788329979.320183:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329979.332180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329979.334924:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339776 00000100:00100000:2.0:1788329979.334948:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339776 00000100:00100000:3.0:1788329979.336766:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:3.0:1788329979.336785:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5669:x1875199729339776:12345-192.168.202.47@tcp:13: 00002000:00000024:3.0:1788329979.336846:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788329979.336939:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5669:x1875199729339776:12345-192.168.202.47@tcp:13: Request processed in 158us (4794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329979.336947:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00080000:1.0:1788329979.337177:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788329979.341576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329979.348629:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729339904 00000100:00100000:1.0:1788329979.348648:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729339904 00000100:00100000:0.0:1788329979.353258:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:0.0:1788329979.353279:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5669:x1875199729339904:12345-192.168.202.47@tcp:13: 00002000:00000024:0.0:1788329979.353341:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788329979.353445:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7a815e47-382d-4064-91e8-23b9de97ce7e+6:5669:x1875199729339904:12345-192.168.202.47@tcp:13: Request processed in 172us (11879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329979.353453:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00080000:1.0:1788329979.364171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788329979.557005:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329980.064284:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329980.064315:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750333824:0@lo:13: 00000100:00100000:3.0:1788329980.064380:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329980.064616:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333824 00000100:00100000:0.0:1788329980.064625:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333824 00000100:00100000:0.0:1788329980.064684:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788329980.064693:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750333824:12345-0@lo:13: 00002000:00000024:0.0:1788329980.064718:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788329980.064766:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750333824:12345-0@lo:13: Request processed in 74us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329980.064774:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788329980.064816:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfa680 x1875199750333824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329980.064840:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750333824:0@lo:13: 00000100:00080000:3.0:1788329980.065099:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788329980.108358:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00010000:00010000:2.0:1788329980.577966:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788329981.126761:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000001:00100000:2.0:1788329981.130042:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00010000:00010000:0.0:1788329981.599923:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329981.763664:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329981.763710:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329981.763757:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329981.763788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340160 00000100:00100000:3.0:1788329981.763798:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340160 00000100:00100000:3.0:1788329981.763880:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:3.0:1788329981.763891:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729340160:12345-192.168.202.47@tcp:400: 00000100:00100000:3.0:1788329981.763969:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729340160:12345-192.168.202.47@tcp:400: Request processed in 79us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329981.763977:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:3.0:1788329981.764006:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340416 00000100:00100000:3.0:1788329981.764011:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340416 00000100:00100000:3.0:1788329981.764041:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:3.0:1788329981.764048:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729340416:12345-192.168.202.47@tcp:400: 00000100:00100000:3.0:1788329981.764077:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729340416:12345-192.168.202.47@tcp:400: Request processed in 30us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329981.764084:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00080000:3.0:1788329981.764101:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788329981.764105:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788329981.764229:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340032 00000100:00100000:1.0:1788329981.764234:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340032 00000100:00100000:1.0:1788329981.764305:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 131 00000100:00100000:1.0:1788329981.764315:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729340032:12345-192.168.202.47@tcp:400: 00000100:00100000:1.0:1788329981.764357:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729340032:12345-192.168.202.47@tcp:400: Request processed in 33us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329981.764381:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 131 00000100:00100000:2.0:1788329981.769025:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329981.769161:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340288 00000100:00100000:3.0:1788329981.769171:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340288 00000100:00100000:3.0:1788329981.769236:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:3.0:1788329981.769245:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2349:x1875199729340288:12345-192.168.202.47@tcp:400: 00000100:00100000:3.0:1788329981.769309:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2349:x1875199729340288:12345-192.168.202.47@tcp:400: Request processed in 65us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329981.769329:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00080000:2.0:1788329981.769497:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788329982.172055:0:8285:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788329982.624445:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329983.135814:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750333952:0@lo:400: 00000100:00100000:3.0:1788329983.135889:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329983.136060:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750334464:0@lo:400: 00000100:00100000:3.0:1788329983.136090:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329983.136127:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788329983.136134:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750334080:0@lo:400: 00000100:00100000:3.0:1788329983.136157:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329983.136172:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750334592:0@lo:400: 00000100:00100000:3.0:1788329983.136192:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329983.136220:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750334208:0@lo:400: 00000100:00100000:3.0:1788329983.136242:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329983.136258:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788329983.136263:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750334336:0@lo:400: 00000100:00100000:3.0:1788329983.136283:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329983.136314:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750333952 00000100:00100000:3.0:1788329983.136323:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750333952 00000100:00100000:3.0:1788329983.136370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788329983.136379:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750333952:12345-0@lo:400: 00000100:00100000:3.0:1788329983.136429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750333952:12345-0@lo:400: Request processed in 50us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329983.136436:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788329983.136466:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334464 00000100:00100000:3.0:1788329983.136469:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334464 00000100:00100000:3.0:1788329983.136498:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334080 00000100:00100000:3.0:1788329983.136501:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334080 00000100:00100000:3.0:1788329983.136554:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334208 00000100:00100000:3.0:1788329983.136557:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334208 00000100:00100000:3.0:1788329983.136572:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788329983.136578:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750334464:12345-0@lo:400: 00000100:00100000:3.0:1788329983.136611:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750334464:12345-0@lo:400: Request processed in 33us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329983.136617:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788329983.136630:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788329983.136636:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750334080:12345-0@lo:400: 00000100:00100000:3.0:1788329983.136661:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750334080:12345-0@lo:400: Request processed in 26us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329983.136668:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788329983.136679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788329983.136684:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750334208:12345-0@lo:400: 00000100:00100000:3.0:1788329983.136712:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750334208:12345-0@lo:400: Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329983.136717:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788329983.136738:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334592 00000100:00100000:3.0:1788329983.136741:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334592 00000100:00100000:3.0:1788329983.136765:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334336 00000100:00100000:3.0:1788329983.136768:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334336 00000100:00100000:3.0:1788329983.136787:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788329983.136793:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750334592:12345-0@lo:400: 00000100:00080000:0.0:1788329983.138029:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788329983.138035:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788329983.138038:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329983.138057:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788329983.138070:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750334336:12345-0@lo:400: 00000100:00100000:0.0:1788329983.138137:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750334336:12345-0@lo:400: Request processed in 72us (1852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329983.138143:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788329983.138184:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750334720:0@lo:13: 00000100:00100000:0.0:1788329983.138218:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788329983.138257:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb1880 x1875199750334336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329983.138271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750334336:0@lo:400: 00000100:00100000:0.0:1788329983.138284:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750334208:0@lo:400: 00000100:00100000:1.0:1788329983.138580:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750334080:0@lo:400: 00000100:00100000:1.0:1788329983.138591:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750333952:0@lo:400: 00000100:00100000:1.0:1788329983.138600:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750334464:0@lo:400: 00000100:00100000:3.0:1788329983.141207:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750334592:12345-0@lo:400: Request processed in 4403us (5002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329983.141223:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788329983.141415:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334720 00000100:00100000:0.0:1788329983.141426:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334720 00000100:00100000:0.0:1788329983.141493:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788329983.141503:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750334720:12345-0@lo:13: 00002000:00000024:0.0:1788329983.141568:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788329983.141645:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750334720:12345-0@lo:13: Request processed in 144us (3425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329983.141651:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788329983.141694:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469b7c5c00 x1875199750334720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788329999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329983.141717:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750334720:0@lo:13: 00010000:00080000:1.0:1788329983.146634:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb0a80 x1875199750334592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788329999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329983.146654:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750334592:0@lo:400: 00010000:00010000:1.0:1788329983.649466:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329984.671377:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329985.184017:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788329985.184047:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750334848:0@lo:13: 00000100:00100000:0.0:1788329985.184128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329985.184651:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750334848 00000100:00100000:1.0:1788329985.184661:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750334848 00000100:00100000:1.0:1788329985.184732:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788329985.184743:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750334848:12345-0@lo:13: 00002000:00000024:1.0:1788329985.184781:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788329985.184946:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750334848:12345-0@lo:13: Request processed in 204us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.184954:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788329985.185904:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788329985.185951:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469b7c4380 x1875199750334848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329985.185973:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750334848:0@lo:13: 00000020:00000080:3.0:1788329985.667895:0:8432:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb61fc830 20000000:00000080:3.0:1788329985.667990:0:8432:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff954584b04400 uarg=0000000000000000 20000000:01000000:3.0:1788329985.668033:0:8432:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788329985.668036:0:8432:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788329985.668038:0:8432:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788329985.668043:0:8432:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788329985.668048:0:8432:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788329985.668062:0:8432:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788329985.668064:0:8432:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788329985.668273:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788329985.668276:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788329985.670061:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788329985.670662:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788329985.670975:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788329985.675225:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788329985.675273:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788329985.675277:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788329985.677171:0:8434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788329985.680009:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788329985.680064:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788329985.680136:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788329985.680158:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788329985.680160:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788329985.683199:0:8435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788329985.684232:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788329985.684308:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788329985.684346:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788329985.684365:0:8432:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788329985.684377:0:8432:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788329985.686009:0:8436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788329985.687098:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788329985.687157:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1788329985.687194:0:8432:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:2.0:1788329985.687214:0:8432:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788329985.687239:0:8432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.687260:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688252:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688274:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa717 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688282:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa725 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688290:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa733 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688297:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa74f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688304:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa779 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688313:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688339:0:8432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688347:0:8432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688457:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.688476:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 9 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.688499:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750334976:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788329985.689037:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.689047:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 9 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.689058:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335104:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788329985.689100:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa779 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.689108:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa779 expref: 18 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.689118:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335232:0@lo:104: 00000100:00100000:2.0:1788329985.689157:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788329985.689256:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa74f expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.689265:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa74f expref: 18 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.689274:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335360:0@lo:104: 00000100:00100000:2.0:1788329985.689299:0:8432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.694007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329985.694051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329985.694093:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340544 00000100:00100000:3.0:1788329985.694103:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340544 00010000:00010000:3.0:1788329985.694153:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 10 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329985.694181:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340672 00000100:00100000:3.0:1788329985.694183:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340672 00010000:00010000:3.0:1788329985.694195:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 11 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329985.694209:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:3.0:1788329985.694217:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:2347:x1875199729340544:12345-192.168.202.47@tcp:103: 00010000:00010000:3.0:1788329985.694232:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329985.694238:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 11 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.694266:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 11 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.694287:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329985.694334:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:2347:x1875199729340544:12345-192.168.202.47@tcp:103: Request processed in 117us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329985.694342:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:3.0:1788329985.694360:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788329985.694367:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2347:x1875199729340672:12345-192.168.202.47@tcp:103: 00010000:00010000:3.0:1788329985.694374:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329985.694379:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 10 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.694389:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 10 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.694399:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329985.694414:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2347:x1875199729340672:12345-192.168.202.47@tcp:103: Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329985.694421:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00010000:00010000:2.0:1788329985.696466:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa733 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.696485:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa733 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.696502:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335488:0@lo:104: 00010000:00010000:2.0:1788329985.696591:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa725 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.696599:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa725 expref: 18 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.696608:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335616:0@lo:104: 00010000:00010000:2.0:1788329985.696633:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa717 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.696641:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa717 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.696649:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335744:0@lo:104: 00010000:00010000:2.0:1788329985.696671:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.696705:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.696714:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335872:0@lo:104: 00010000:00010000:2.0:1788329985.696741:0:8432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.696749:0:8432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 18 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.696757:0:8432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750336000:0@lo:104: 00000100:00100000:2.0:1788329985.697221:0:8432:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f800c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788329985.697257:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20ccc00/0x91094de4de9aa795 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea29 expref: 9 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.697272:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750334976:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788329985.697284:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cde00/0x91094de4de9aa78e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea22 expref: 8 pid: 5838 timeout: 340 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.697295:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335104:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788329985.697548:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788329985.697580:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329985.697598:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329985.697608:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329985.697616:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329985.697625:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329985.697634:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750335232 00000100:00100000:1.0:1788329985.697649:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750335232 00000100:00100000:1.0:1788329985.697704:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750335360 00000100:00100000:1.0:1788329985.697708:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750335360 00000100:00100000:1.0:1788329985.697721:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750335488 00000100:00100000:1.0:1788329985.697723:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750335488 00000100:00100000:1.0:1788329985.697732:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750335616 00000100:00100000:1.0:1788329985.697734:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750335616 00000100:00100000:1.0:1788329985.697743:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750335744 00000100:00100000:1.0:1788329985.697745:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750335744 00000100:00100000:1.0:1788329985.697754:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750335872 00000100:00100000:1.0:1788329985.697756:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750335872 00000100:00100000:1.0:1788329985.697765:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336000 00000100:00100000:1.0:1788329985.697767:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336000 00000100:00100000:1.0:1788329985.697993:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788329985.698003:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:8432:x1875199750335232:12345-0@lo:104: 00010000:00010000:1.0:1788329985.698018:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.698099:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329985.698106:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+9:8432:x1875199750335232:12345-0@lo:104: Request processed in 105us (8948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.698114:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788329985.698131:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788329985.698138:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+8:8432:x1875199750335360:12345-0@lo:104: 00010000:00010000:1.0:1788329985.698146:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.698191:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788329985.698196:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+8:8432:x1875199750335360:12345-0@lo:104: Request processed in 60us (8897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.698202:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788329985.698244:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788329985.698250:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+7:8432:x1875199750335488:12345-0@lo:104: 00010000:00010000:1.0:1788329985.698258:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.698286:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788329985.698290:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+7:8432:x1875199750335488:12345-0@lo:104: Request processed in 41us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.698296:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788329985.698307:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788329985.698313:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:8432:x1875199750335616:12345-0@lo:104: 00010000:00010000:3.0:1788329985.698589:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788329985.698597:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698605:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.698610:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698632:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.698640:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.698646:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.698694:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698701:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.698720:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698728:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cd600/0x91094de4de9aa779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa780 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698743:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788329985.698746:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698752:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc600 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.698755:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.698762:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.698769:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.699001:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.699017:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699024:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.699030:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699037:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cc600/0x91094de4de9aa74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa756 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699050:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329985.699054:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699060:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9c00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.699063:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699070:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.699077:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.699082:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.699106:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699112:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.699133:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699140:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa733 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa73a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.699151:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.699152:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.699155:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.699163:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329985.699176:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336256:0@lo:103: 00000100:00100000:3.0:1788329985.699215:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.699242:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788329985.699248:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336128:0@lo:103: 00000100:00100000:3.0:1788329985.699267:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.699288:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788329985.699295:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750336384:0@lo:103: 00010000:00010000:1.0:1788329985.699527:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.699571:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329985.699577:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+6:8432:x1875199750335616:12345-0@lo:104: Request processed in 1264us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.699585:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788329985.699606:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788329985.699615:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:8432:x1875199750335744:12345-0@lo:104: 00010000:00010000:1.0:1788329985.699623:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.699651:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788329985.699656:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:8432:x1875199750335744:12345-0@lo:104: Request processed in 44us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.699662:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788329985.699829:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335232:0@lo:104: 00000100:00100000:2.0:1788329985.699842:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335360:0@lo:104: 00000100:00100000:2.0:1788329985.699850:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335488:0@lo:104: 00000100:00100000:2.0:1788329985.699858:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335616:0@lo:104: 00000100:00100000:2.0:1788329985.699865:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335744:0@lo:104: 00000100:00100000:3.0:1788329985.700036:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788329985.700094:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788329985.700099:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700106:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680031c00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.700110:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700117:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.700124:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.700136:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.700155:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700161:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.700172:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700179:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa72c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700191:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329985.700194:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700200:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680030400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.700202:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700208:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.700214:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.700219:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.700230:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700235:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.700250:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700257:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa71e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.700266:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.700268:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.700270:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329985.700279:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788329985.700295:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336640:0@lo:103: 00000100:00100000:3.0:1788329985.700335:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.700356:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336256 00000100:00100000:3.0:1788329985.700363:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336256 00000100:00100000:1.0:1788329985.700890:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788329985.701033:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:8432:x1875199750335872:12345-0@lo:104: 00010000:00010000:1.0:1788329985.701043:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.701124:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329985.701130:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:8432:x1875199750335872:12345-0@lo:104: Request processed in 104us (3512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.701137:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788329985.701155:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788329985.701162:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:8432:x1875199750336000:12345-0@lo:104: 00010000:00010000:1.0:1788329985.701172:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.701198:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788329985.701203:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:8432:x1875199750336000:12345-0@lo:104: Request processed in 42us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329985.701209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788329985.701445:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336128 00000100:00100000:2.0:1788329985.701451:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336128 00010000:00010000:2.0:1788329985.701473:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa779 expref: 20 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.701490:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336384 00000100:00100000:2.0:1788329985.701493:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336384 00010000:00010000:2.0:1788329985.701503:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa733 expref: 21 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.701513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336640 00000100:00100000:2.0:1788329985.701529:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336640 00010000:00010000:2.0:1788329985.701540:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa717 expref: 22 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329985.701553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788329985.701559:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+22:3315:x1875199750336128:12345-0@lo:103: 00010000:00010000:2.0:1788329985.701568:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329985.701573:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa779 expref: 22 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701586:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa779 expref: 22 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701603:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680030600/0x91094de4de9aa780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa779 expref: 22 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701617:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329985.701651:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+21:3315:x1875199750336128:12345-0@lo:103: Request processed in 93us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329985.701657:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788329985.701691:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788329985.701698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3313:x1875199750336384:12345-0@lo:103: 00010000:00010000:2.0:1788329985.701706:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329985.701711:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa733 expref: 20 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701721:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa733 expref: 20 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701731:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9aa73a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa733 expref: 20 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701741:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329985.701765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750336384:12345-0@lo:103: Request processed in 68us (2449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329985.701771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788329985.701796:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788329985.701802:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:3315:x1875199750336640:12345-0@lo:103: 00010000:00010000:2.0:1788329985.701810:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788329985.701814:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa717 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701822:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa717 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701831:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d9200/0x91094de4de9aa71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa717 expref: 18 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329985.701839:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788329985.701860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3315:x1875199750336640:12345-0@lo:103: Request processed in 58us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329985.701871:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788329985.702238:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa74f expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329985.702266:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788329985.702275:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3315:x1875199750336256:12345-0@lo:103: 00010000:00010000:3.0:1788329985.702283:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329985.702287:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa74f expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702297:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa74f expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702308:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa74f expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702321:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788329985.702356:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:3315:x1875199750336256:12345-0@lo:103: Request processed in 84us (3140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329985.702363:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788329985.702501:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750335872:0@lo:104: 00000100:00100000:2.0:1788329985.702511:0:8432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8432:1875199750336000:0@lo:104: 00010000:00010000:2.0:1788329985.702577:0:8432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702631:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788329985.702637:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702643:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.702647:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702655:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.702662:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.702668:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.702701:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702707:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.702716:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702722:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8400/0x91094de4de9aa6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6f4 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702733:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329985.702737:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702751:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e200 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329985.702755:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702761:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329985.702768:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329985.702838:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788329985.702854:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702859:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329985.702866:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702873:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6ca expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.702886:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.702888:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329985.702890:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329985.703019:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336768:0@lo:103: 00000100:00100000:3.0:1788329985.703065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.703127:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336640:0@lo:103: 00000100:00100000:3.0:1788329985.703137:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336128:0@lo:103: 00000100:00100000:3.0:1788329985.703159:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336256:0@lo:103: 00000100:00100000:3.0:1788329985.703190:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750336512:0@lo:103: 00000100:00100000:3.0:1788329985.703213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329985.703229:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750336384:0@lo:103: 00000100:00100000:3.0:1788329985.703239:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788329985.703244:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750336896:0@lo:103: 00000100:00100000:3.0:1788329985.703262:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788329985.703279:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788329985.703289:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336768 00000100:00100000:3.0:1788329985.703295:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336768 00010000:00010000:3.0:1788329985.703317:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 15 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329985.703333:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336512 00000100:00100000:3.0:1788329985.703335:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336512 00010000:00010000:3.0:1788329985.703346:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa725 expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329985.703355:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750336896 00000100:00100000:3.0:1788329985.703357:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750336896 00010000:00010000:3.0:1788329985.703366:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 17 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329985.703378:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788329985.703567:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788329985.703578:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788329985.703638:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a373050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3315:x1875199750336768:12345-0@lo:103: 00010000:00010000:3.0:1788329985.703650:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788329985.703656:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 17 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.703741:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 17 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.703757:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680030000/0x91094de4de9aa6f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa6ed expref: 17 pid: 5837 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329985.703769:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329985.704034:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788329985.704172:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788329985.704183:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788329985.704193:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3313:x1875199750336512:12345-0@lo:103: 00010000:00010000:0.0:1788329985.704203:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329985.704209:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa725 expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704220:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa725 expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704231:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8e00/0x91094de4de9aa72c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa725 expref: 16 pid: 5839 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704244:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329985.704504:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:3313:x1875199750336512:12345-0@lo:103: Request processed in 313us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329985.704511:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788329985.704563:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788329985.704570:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788329985.704577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:3313:x1875199750336896:12345-0@lo:103: 00010000:00010000:0.0:1788329985.704587:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329985.704592:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 14 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704602:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 14 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704613:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa6ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa6c3 expref: 14 pid: 5838 timeout: 390 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704639:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704648:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704664:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704672:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704691:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704698:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704705:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788329985.704710:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704718:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704737:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329985.704749:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788329985.705046:0:8432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.705055:0:8432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329985.705062:0:8432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214e000/0x91094de4de9aa7cd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329985.705868:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:3313:x1875199750336896:12345-0@lo:103: Request processed in 198us (1511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329985.705892:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788329985.706335:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750336896:0@lo:103: 00000100:00100000:2.0:1788329985.706347:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750336512:0@lo:103: 00000100:00100000:3.0:1788329985.708593:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a373050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:3315:x1875199750336768:12345-0@lo:103: Request processed in 5194us (5513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329985.708613:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788329985.709047:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750336768:0@lo:103: 00010000:00010000:3.0:1788329986.718900:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788329986.847336:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788329986.847344:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954682f55000 from 39 10000000:01000000:0.0:1788329986.847350:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788329986.847425:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.847437:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.847450:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.847477:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337024:0@lo:101: 00000100:00100000:0.0:1788329986.847598:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.847726:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.849406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337024 00000100:00100000:3.0:1788329986.849433:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337024 00000100:00100000:3.0:1788329986.849594:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788329986.849606:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+12:5841:x1875199750337024:12345-0@lo:101: 00010000:00010000:3.0:1788329986.849636:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329986.849675:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa7db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa7d4 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.850112:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa7d4 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.850133:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa7db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa7d4 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.850211:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8400, rc 0) 00000100:00100000:3.0:1788329986.850909:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750337024:12345-0@lo:101: Request processed in 1303us (3307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.851019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788329986.851893:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337024:0@lo:101: 00010000:00010000:0.0:1788329986.851919:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.852070:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.852330:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337152:0@lo:501: 00000100:00100000:0.0:1788329986.852382:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.852436:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.852537:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337152 00000100:00100000:1.0:1788329986.852544:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337152 00000100:00100000:1.0:1788329986.852609:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788329986.852623:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750337152:12345-0@lo:501: 00000100:00100000:1.0:1788329986.853096:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750337152:12345-0@lo:501: Request processed in 477us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.853104:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788329986.853248:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337152:0@lo:501: 00000100:00100000:0.0:1788329986.853293:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337280:0@lo:503: 00000100:00100000:0.0:1788329986.853331:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.853362:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788329986.853427:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337280 00000100:00100000:2.0:1788329986.853433:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337280 00000100:00100000:2.0:1788329986.853465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788329986.853472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750337280:12345-0@lo:503: 00000100:00100000:2.0:1788329986.853680:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750337280:12345-0@lo:503: Request processed in 208us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329986.854231:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788329986.854894:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337280:0@lo:503: 00000100:00100000:1.0:1788329986.856085:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8451:1875199750337408:0@lo:502: 00000100:00100000:1.0:1788329986.857098:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329986.859395:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546915d7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.864927:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337408 00000100:00100000:3.0:1788329986.864948:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337408 00000100:00100000:3.0:1788329986.865100:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788329986.865111:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:8451:x1875199750337408:12345-0@lo:502: 00000100:00100000:3.0:1788329986.865452:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:8451:x1875199750337408:12345-0@lo:502: Request processed in 342us (8354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.865460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788329986.865570:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8451:1875199750337408:0@lo:502: 00000100:00100000:2.0:1788329986.865642:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8451:1875199750337536:0@lo:502: 00000100:00100000:2.0:1788329986.865693:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.887611:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788329986.887704:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329986.887735:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329986.887780:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329986.889874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337536 00000100:00100000:1.0:1788329986.889891:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337536 00000100:00100000:0.0:1788329986.894723:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788329986.894904:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341184 00000100:00100000:0.0:1788329986.894916:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341184 00000100:00100000:0.0:1788329986.895003:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:0.0:1788329986.895013:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729341184:12345-192.168.202.47@tcp:400: 00000100:00100000:0.0:1788329986.896317:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729341184:12345-192.168.202.47@tcp:400: Request processed in 109us (7383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.896336:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00080000:0.0:1788329986.897214:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788329986.897363:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340928 00000100:00100000:3.0:1788329986.897451:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340928 00000100:00100000:3.0:1788329986.898397:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:3.0:1788329986.898411:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729340928:12345-192.168.202.47@tcp:400: 00000100:00100000:3.0:1788329986.899153:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729340928:12345-192.168.202.47@tcp:400: Request processed in 741us (11449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.899171:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00080000:0.0:1788329986.902965:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329986.902999:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:8451:x1875199750337536:12345-0@lo:502: 00000100:00100000:0.0:1788329986.903313:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:8451:x1875199750337536:12345-0@lo:502: Request processed in 8574us (37618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.903323:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788329986.903371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729340800 00000100:00100000:0.0:1788329986.904731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729340800 00000100:00100000:0.0:1788329986.904807:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 138 00000100:00100000:0.0:1788329986.904817:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:2348:x1875199729340800:12345-192.168.202.47@tcp:400: 00000100:00100000:0.0:1788329986.905084:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:2348:x1875199729340800:12345-192.168.202.47@tcp:400: Request processed in 258us (17293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.905096:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 138 00000100:00100000:2.0:1788329986.906051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329986.906149:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8451:1875199750337536:0@lo:502: 00000040:00080000:2.0:1788329986.906199:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1788329986.906645:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341056 00000100:00100000:3.0:1788329986.906653:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341056 00000100:00100000:3.0:1788329986.906731:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:3.0:1788329986.906750:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729341056:12345-192.168.202.47@tcp:400: 00000100:00100000:3.0:1788329986.906827:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729341056:12345-192.168.202.47@tcp:400: Request processed in 87us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.906835:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00000020:01000000:0.0:1788329986.907228:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788329986.907252:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788329986.907263:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.907275:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329986.907286:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788329986.907289:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788329986.907292:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788329986.907329:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.907338:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.907347:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.907370:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337664:0@lo:101: 00000100:00100000:0.0:1788329986.907440:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.907647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337664 00000100:00100000:2.0:1788329986.907654:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337664 00000100:00100000:2.0:1788329986.907694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788329986.907702:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+13:5841:x1875199750337664:12345-0@lo:101: 00010000:00010000:2.0:1788329986.907712:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329986.907728:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa7e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa7e2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.907762:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa7e2 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.907774:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa7e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa7e2 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.907783:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fa00, rc 0) 00000100:00100000:2.0:1788329986.907818:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750337664:12345-0@lo:101: Request processed in 117us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329986.907824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788329986.907935:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.907954:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337664:0@lo:101: 00010000:00010000:0.0:1788329986.907967:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.907976:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.908049:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337792:0@lo:501: 00000100:00100000:0.0:1788329986.908088:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.908306:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788329986.909687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337792 00000100:00100000:2.0:1788329986.909699:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337792 00000100:00100000:2.0:1788329986.909768:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788329986.909778:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750337792:12345-0@lo:501: 00000100:00100000:2.0:1788329986.911649:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750337792:12345-0@lo:501: Request processed in 1865us (3551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329986.911663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788329986.911870:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788329986.911929:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337792:0@lo:501: 00000100:00100000:1.0:1788329986.911986:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337920:0@lo:503: 00000100:00100000:1.0:1788329986.912046:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329986.912099:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546915d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.912150:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750337920 00000100:00100000:3.0:1788329986.912157:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750337920 00000100:00100000:3.0:1788329986.912213:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788329986.912223:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750337920:12345-0@lo:503: 00000100:00100000:3.0:1788329986.912742:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750337920:12345-0@lo:503: Request processed in 520us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.912751:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788329986.912791:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750337920:0@lo:503: 00000100:00100000:1.0:1788329986.913747:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8452:1875199750338048:0@lo:502: 00000100:00100000:1.0:1788329986.913807:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329986.913850:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546915d73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.913990:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338048 00000100:00100000:0.0:1788329986.913997:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338048 00000100:00100000:0.0:1788329986.914039:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788329986.914048:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:8452:x1875199750338048:12345-0@lo:502: 00000100:00100000:0.0:1788329986.914260:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:8452:x1875199750338048:12345-0@lo:502: Request processed in 212us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.914267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788329986.914637:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8452:1875199750338048:0@lo:502: 00000020:01000000:1.0:1788329986.914670:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788329986.914680:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329986.914683:0:8452:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788329986.914691:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788329986.914714:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8452:1875199750338176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788329986.914750:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329986.914787:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546915d73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.914860:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338176 00000100:00100000:3.0:1788329986.914866:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338176 00000100:00100000:3.0:1788329986.914905:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788329986.914913:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:8452:x1875199750338176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329986.915158:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:8452:x1875199750338176:12345-0@lo:502:llog_process_th.0 Request processed in 245us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.915165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788329986.915634:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8452:1875199750338176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788329986.915664:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788329986.915668:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329986.915670:0:8452:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788329986.915675:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788329986.917496:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1788329986.917566:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788329986.917579:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.917592:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329986.917603:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788329986.917605:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9546a001c800 from 39 10000000:01000000:0.0:1788329986.917608:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788329986.917650:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.917658:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.917691:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.917717:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.917777:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.917823:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.917966:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338304 00000100:00100000:1.0:1788329986.917973:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338304 00000100:00100000:1.0:1788329986.918024:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788329986.918034:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:5841:x1875199750338304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788329986.918049:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329986.918064:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468148b000/0x91094de4de9aa7f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa7f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.918101:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468148b000/0x91094de4de9aa7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa7f0 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.918112:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468148b000/0x91094de4de9aa7f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa7f0 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.918121:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468148b000, rc 0) 00000100:00100000:1.0:1788329986.918177:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750338304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.918184:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788329986.918339:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788329986.918356:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.918364:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329986.918618:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.918651:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.918683:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.918719:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338432 00000100:00100000:1.0:1788329986.918724:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338432 00000100:00100000:1.0:1788329986.918755:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788329986.918762:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750338432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788329986.919026:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750338432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.919043:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788329986.919224:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.919254:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.919293:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.919321:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.919405:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338560 00000100:00100000:1.0:1788329986.919410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338560 00000100:00100000:1.0:1788329986.919445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788329986.919452:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750338560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788329986.921938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750338560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2478us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.921951:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788329986.922059:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.922510:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8453:1875199750338688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329986.922582:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.922621:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.922661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338688 00000100:00100000:1.0:1788329986.922667:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338688 00000100:00100000:1.0:1788329986.922713:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788329986.922722:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:8453:x1875199750338688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788329986.922967:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:8453:x1875199750338688:12345-0@lo:502:llog_process_th.0 Request processed in 246us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.922974:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788329986.923494:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8453:1875199750338688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329986.923565:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8453:1875199750338816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329986.923602:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.923629:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.923680:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338816 00000100:00100000:0.0:1788329986.923686:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338816 00000100:00100000:0.0:1788329986.923724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788329986.923733:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:8453:x1875199750338816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329986.923905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:8453:x1875199750338816:12345-0@lo:502:llog_process_th.0 Request processed in 173us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.923913:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788329986.925691:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8453:1875199750338816:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788329986.925741:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788329986.929907:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788329986.929949:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788329986.929962:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.929974:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788329986.929986:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788329986.929989:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788329986.929992:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788329986.930048:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.930056:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.930121:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.930152:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.930233:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.930276:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.930359:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750338944 00000100:00100000:3.0:1788329986.930367:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750338944 00000100:00100000:3.0:1788329986.930430:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788329986.930440:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:5841:x1875199750338944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788329986.930453:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329986.930467:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa7fe expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.930505:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa7fe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.930534:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa7fe expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.930544:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8600, rc 0) 00000100:00100000:3.0:1788329986.930595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750338944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.930612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788329986.932137:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750338944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788329986.932165:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.932176:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329986.932258:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.932308:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.932353:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.932427:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339072 00000100:00100000:3.0:1788329986.932434:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339072 00000100:00100000:3.0:1788329986.932482:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788329986.932501:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750339072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.933036:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750339072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 534us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.933044:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788329986.934336:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.934408:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.934473:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.934530:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.934881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339200 00000100:00100000:0.0:1788329986.934888:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339200 00000100:00100000:0.0:1788329986.934938:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788329986.934947:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750339200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.935167:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750339200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.935186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788329986.935909:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.938368:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8454:1875199750339328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329986.938724:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.938757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339328 00000100:00100000:0.0:1788329986.938762:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788329986.938770:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339328 00000100:00100000:2.0:1788329986.938828:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788329986.938837:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:8454:x1875199750339328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329986.939093:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:8454:x1875199750339328:12345-0@lo:502:llog_process_th.0 Request processed in 257us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329986.939102:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788329986.939123:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8454:1875199750339328:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788329986.939153:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788329986.939161:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329986.939164:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788329986.939170:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788329986.939328:0:8454:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8454:1875199750339456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329986.939365:0:8454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.939429:0:8454:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.943785:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339456 00000100:00100000:3.0:1788329986.943802:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339456 00000100:00100000:2.0:1788329986.943976:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788329986.943986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:8454:x1875199750339456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329986.944292:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:8454:x1875199750339456:12345-0@lo:502:llog_process_th.0 Request processed in 306us (4925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329986.944299:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788329986.944320:0:8454:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8454:1875199750339456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788329986.944355:0:8454:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788329986.944363:0:8454:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329986.944365:0:8454:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788329986.944384:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1788329986.944862:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1788329986.944885:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788329986.944898:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.944911:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329986.944921:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788329986.944926:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954689604000 from 39 10000000:01000000:3.0:1788329986.944929:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788329986.945231:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.945241:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.945252:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329986.945276:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788329986.945326:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.945369:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.945572:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339584 00000100:00100000:1.0:1788329986.945579:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339584 00000100:00100000:1.0:1788329986.945626:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788329986.945636:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750339584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788329986.945647:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329986.945661:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468148ac00/0x91094de4de9aa813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa80c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.945696:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468148ac00/0x91094de4de9aa813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa80c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.945707:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468148ac00/0x91094de4de9aa813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa80c expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.945715:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468148ac00, rc 0) 00000100:00100000:1.0:1788329986.945768:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750339584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.945774:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788329986.945819:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788329986.945833:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.945852:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329986.945904:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788329986.945929:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.945966:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.946149:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339712 00000100:00100000:0.0:1788329986.946155:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339712 00000100:00100000:0.0:1788329986.946188:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788329986.946206:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750339712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.946475:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750339712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.946482:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788329986.946974:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.947022:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.947061:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.947102:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788329986.947106:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339840 00000100:00100000:1.0:1788329986.947111:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339840 00000100:00100000:1.0:1788329986.947150:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788329986.947157:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750339840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788329986.947354:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750339840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 196us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329986.947362:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788329986.947632:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750339840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788329986.951147:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8455:1875199750339968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329986.951223:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.951281:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.951292:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750339968 00000100:00100000:0.0:1788329986.951299:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750339968 00000100:00100000:0.0:1788329986.951351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788329986.951360:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8455:x1875199750339968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329986.951811:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8455:x1875199750339968:12345-0@lo:502:llog_process_th.0 Request processed in 451us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.951820:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788329986.952227:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8455:1875199750339968:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329986.952302:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8455:1875199750340096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329986.952343:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329986.953944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340096 00000100:00100000:0.0:1788329986.953979:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340096 00000100:00100000:0.0:1788329986.954092:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788329986.954102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8455:x1875199750340096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329986.954604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8455:x1875199750340096:12345-0@lo:502:llog_process_th.0 Request processed in 502us (2258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.954612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788329986.962091:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788329986.962157:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8455:1875199750340096:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788329986.962210:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788329986.962433:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788329986.962454:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788329986.962466:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.962478:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329986.962500:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788329986.962503:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788329986.962506:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788329986.962580:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.962588:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.962597:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329986.962617:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.962680:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.962707:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.962881:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340224 00000100:00100000:0.0:1788329986.962889:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340224 00000100:00100000:0.0:1788329986.962943:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788329986.962953:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750340224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788329986.962976:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329986.962990:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680031800/0x91094de4de9aa821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa81a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.963013:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680031800/0x91094de4de9aa821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa81a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.963023:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680031800/0x91094de4de9aa821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa81a expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329986.963032:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680031800, rc 0) 00000100:00100000:0.0:1788329986.963082:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750340224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.963089:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788329986.963356:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788329986.963381:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.963391:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329986.963452:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.963478:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.963512:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.963701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340352 00000100:00100000:0.0:1788329986.963707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340352 00000100:00100000:0.0:1788329986.963740:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788329986.963747:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750340352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.964058:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750340352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.964066:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788329986.964271:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.964302:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.964341:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.964376:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a000 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.964432:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340480 00000100:00100000:0.0:1788329986.964436:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340480 00000100:00100000:0.0:1788329986.964470:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788329986.964477:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750340480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788329986.964666:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750340480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.964673:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788329986.964997:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.966056:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8456:1875199750340608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329986.966128:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.966168:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788329986.966317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340608 00000100:00100000:0.0:1788329986.966324:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340608 00000100:00100000:0.0:1788329986.966364:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788329986.966373:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8456:x1875199750340608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329986.966908:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8456:x1875199750340608:12345-0@lo:502:llog_process_th.0 Request processed in 534us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329986.966917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788329986.967054:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8456:1875199750340608:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788329986.967094:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329986.967103:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329986.967106:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788329986.967111:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788329986.967136:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8456:1875199750340736:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329986.967170:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329986.967218:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788329986.967256:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340736 00000100:00100000:2.0:1788329986.967262:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340736 00000100:00100000:2.0:1788329986.967302:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788329986.967311:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8456:x1875199750340736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329986.967495:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8456:x1875199750340736:12345-0@lo:502:llog_process_th.0 Request processed in 184us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329986.967502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788329986.967540:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8456:1875199750340736:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788329986.967559:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329986.967563:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329986.967565:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788329986.967568:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788329986.969247:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1788329986.969279:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788329986.969307:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.969320:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329986.969332:0:5841:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788329986.969336:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9546b4ba4d28 from 1 10000000:01000000:2.0:1788329986.969339:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788329986.969388:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.969397:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.969408:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329986.969432:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788329986.969502:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.969560:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.969591:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340864 00000100:00100000:3.0:1788329986.969600:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340864 00000100:00100000:3.0:1788329986.969649:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788329986.969658:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750340864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788329986.969669:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329986.969682:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9800/0x91094de4de9aa82f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa828 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.969704:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9800/0x91094de4de9aa82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa828 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.969714:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9800/0x91094de4de9aa82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa828 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329986.969722:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9800, rc 0) 00000100:00100000:3.0:1788329986.969760:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750340864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329986.969766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788329986.971667:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788329986.971692:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329986.971704:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329986.971783:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788329986.971847:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329986.971897:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788329986.972760:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750340992 00000100:00100000:3.0:1788329986.972771:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750340992 00000100:00100000:3.0:1788329986.972830:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788329986.972841:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750340992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329986.973152:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750340992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 311us (1304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788329986.973168:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788329986.973614:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750340992:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788329986.973647:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788329986.973657:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329986.973667:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329987.458891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329987.459178:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341312 00000100:00100000:3.0:1788329987.459190:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341312 00000100:00100000:3.0:1788329987.459250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 166 00000100:00100000:3.0:1788329987.459260:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:5591:x1875199729341312:12345-192.168.202.47@tcp:101: 00010000:00010000:3.0:1788329987.459275:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788329987.459291:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8000/0x91094de4de9aa836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea8b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329987.459317:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8000/0x91094de4de9aa836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea8b expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329987.459328:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8000/0x91094de4de9aa836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea8b expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329987.459336:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8000, rc 0) 00000100:00100000:3.0:1788329987.459404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729341312:12345-192.168.202.47@tcp:101: Request processed in 137us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329987.459411:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 166 00000100:00100000:3.0:1788329987.466357:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329987.466568:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341440 00000100:00100000:2.0:1788329987.466581:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341440 00000100:00100000:2.0:1788329987.466645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 167 00000100:00100000:2.0:1788329987.466657:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729341440:12345-192.168.202.47@tcp:501: 00000100:00100000:2.0:1788329987.467022:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729341440:12345-192.168.202.47@tcp:501: Request processed in 366us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329987.467031:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 167 00000100:00100000:0.0:1788329987.469127:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329987.469288:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341568 00000100:00100000:2.0:1788329987.469298:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341568 00000100:00100000:2.0:1788329987.469362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 168 00000100:00100000:2.0:1788329987.469378:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729341568:12345-192.168.202.47@tcp:503: 00000100:00100000:2.0:1788329987.469912:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729341568:12345-192.168.202.47@tcp:503: Request processed in 537us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329987.469920:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 168 00000100:00100000:1.0:1788329987.479550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329987.479939:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341696 00000100:00100000:3.0:1788329987.479950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341696 00000100:00100000:3.0:1788329987.480016:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 169 00000100:00100000:3.0:1788329987.480028:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:6064:x1875199729341696:12345-192.168.202.47@tcp:502: 00000100:00100000:3.0:1788329987.480329:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:6064:x1875199729341696:12345-192.168.202.47@tcp:502: Request processed in 302us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329987.480337:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 169 00000100:00100000:0.0:1788329987.496803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329987.496889:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341824 00000100:00100000:3.0:1788329987.496900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341824 00000100:00100000:3.0:1788329987.496962:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 170 00000100:00100000:3.0:1788329987.496973:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:6064:x1875199729341824:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788329987.497398:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:6064:x1875199729341824:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 425us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329987.497407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 170 00000100:00100000:0.0:1788329987.505387:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329987.506234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729341952 00000100:00100000:2.0:1788329987.506249:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729341952 00000100:00100000:2.0:1788329987.506358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 171 00000100:00100000:2.0:1788329987.506370:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729341952:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788329987.506389:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329987.506409:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214e800/0x91094de4de9aa83d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea92 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329987.506440:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214e800/0x91094de4de9aa83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea92 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329987.506474:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214e800/0x91094de4de9aa83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea92 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329987.506484:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e800, rc 0) 00000100:00100000:2.0:1788329987.506575:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729341952:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 207us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329987.506582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 171 00000100:00100000:1.0:1788329987.509453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329987.509623:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342080 00000100:00100000:2.0:1788329987.509634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342080 00000100:00100000:2.0:1788329987.509693:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 172 00000100:00100000:2.0:1788329987.509702:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342080:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788329987.510009:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342080:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 298us (558us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788329987.510017:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 172 00010000:00010000:3.0:1788329987.743598:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329988.254794:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750341248:0@lo:400:kworker.0 00000100:00100000:1.0:1788329988.254876:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329988.254985:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750341120:0@lo:400:kworker.0 00000100:00100000:2.0:1788329988.255022:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329988.255086:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750341120 00000100:00100000:2.0:1788329988.255093:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750341120 00000100:00100000:2.0:1788329988.255143:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788329988.255152:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750341120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788329988.255200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750341120:12345-0@lo:400:kworker.0 Request processed in 49us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329988.255208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788329988.255253:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750341120:0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.255907:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750341248 00000100:00100000:0.0:1788329988.255914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750341248 00000100:00100000:0.0:1788329988.255950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788329988.255958:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750341248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788329988.259317:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750341760:0@lo:400:kworker.0 00000100:00100000:1.0:1788329988.259424:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329988.259559:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750341248:12345-0@lo:400:kworker.0 Request processed in 3600us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329988.259590:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788329988.259625:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750341760 00000100:00100000:0.0:1788329988.259633:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750341760 00000100:00100000:0.0:1788329988.259679:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788329988.259688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750341760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.259735:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750341760:12345-0@lo:400:kworker.0 Request processed in 49us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329988.259741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788329988.259780:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329988.259793:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750341504:0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.259819:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329988.259840:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788329988.259846:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750341632:0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.259887:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329988.259916:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750341632 00000100:00100000:0.0:1788329988.259920:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750341632 00000100:00100000:0.0:1788329988.259953:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788329988.259959:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750341632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.259994:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750341632:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329988.260000:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788329988.260018:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788329988.260043:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb2a00 x1875199750341632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329988.260057:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750341632:0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.260088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750341504 00000100:00100000:0.0:1788329988.260098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750341504 00000100:00100000:0.0:1788329988.260122:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788329988.260128:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750341504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.260160:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750341504:12345-0@lo:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329988.260167:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788329988.260181:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329988.260196:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750341504:0@lo:400:kworker.0 00000100:00100000:0.0:1788329988.260229:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750341376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788329988.260255:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329988.260294:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750341376 00000100:00100000:0.0:1788329988.260297:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750341376 00000100:00100000:0.0:1788329988.260329:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788329988.260335:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750341376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788329988.260365:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788329988.260398:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750341376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329988.260404:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788329988.260418:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788329988.260433:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9f480 x1875199750341376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329988.260448:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750341376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788329988.261952:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750341248:0@lo:400:kworker.0 00000100:00100000:1.0:1788329988.261984:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750341760:0@lo:400:kworker.0 00010000:00010000:3.0:1788329988.771432:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788329989.144263:0:8494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe666e5d90 20000000:00000080:3.0:1788329989.144290:0:8494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95469b8a2400 uarg=0000000000000000 20000000:01000000:3.0:1788329989.144336:0:8494:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788329989.144342:0:8494:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788329989.144348:0:8494:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788329989.149852:0:8495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788329989.150105:0:8494:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788329989.163241:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788329989.163832:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788329989.163908:0:8494:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788329989.163927:0:8494:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788329989.163949:0:8494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.163968:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa606 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.163977:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa684 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.163984:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa6df expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.163993:0:8494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.164002:0:8494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.164046:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.164075:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 9 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329989.164092:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750341888:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788329989.164215:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa6df expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.164236:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa6df expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329989.164249:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750342016:0@lo:104: 00000100:00100000:2.0:1788329989.165626:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788329989.167042:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa684 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.167069:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa684 expref: 18 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329989.167083:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750342144:0@lo:104: 00000100:00100000:2.0:1788329989.167193:0:8494:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329989.167350:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329989.167421:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342208 00000100:00100000:3.0:1788329989.167429:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342208 00010000:00010000:3.0:1788329989.167479:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 10 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329989.167538:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:0.0:1788329989.167552:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2346:x1875199729342208:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788329989.167582:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788329989.167589:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 10 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329989.167604:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 10 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329989.167624:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788329989.167672:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2346:x1875199729342208:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 123us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329989.167679:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 21 00010000:00010000:2.0:1788329989.172252:0:8494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa606 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.172287:0:8494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa606 expref: 18 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329989.172303:0:8494:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750342272:0@lo:104: 00000100:00100000:2.0:1788329989.172731:0:8494:0:(client.c:2715:ptlrpc_set_wait()) set ffff954585966d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788329989.172829:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cd200/0x91094de4de9aa7a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea5a expref: 9 pid: 5838 timeout: 344 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329989.172844:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750341888:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788329989.172903:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788329989.172936:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329989.172952:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342016 00000100:00100000:1.0:1788329989.172959:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342016 00000100:00100000:1.0:1788329989.173002:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342144 00000100:00100000:1.0:1788329989.173006:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342144 00000100:00100000:1.0:1788329989.173018:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342272 00000100:00100000:1.0:1788329989.173020:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342272 00000100:00100000:1.0:1788329989.173033:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788329989.173041:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:8494:x1875199750342016:12345-0@lo:104: 00010000:00010000:1.0:1788329989.173067:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.173141:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329989.173149:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:8494:x1875199750342016:12345-0@lo:104: Request processed in 109us (7532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329989.173156:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788329989.173173:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788329989.173186:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329989.173196:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329989.173200:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:8494:x1875199750342144:12345-0@lo:104: 00010000:00010000:3.0:1788329989.173212:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680030800 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329989.173218:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.173227:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173229:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329989.173247:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329989.173253:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788329989.173272:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788329989.173279:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585a0c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:8494:x1875199750342144:12345-0@lo:104: Request processed in 82us (6086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329989.173285:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:3.0:1788329989.173303:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173311:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788329989.173331:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788329989.173338:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:8494:x1875199750342272:12345-0@lo:104: 00010000:00010000:1.0:1788329989.173346:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173349:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173360:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680030800/0x91094de4de9aa6df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa6e6 expref: -99 pid: 7612 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173372:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329989.173376:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.173378:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1788329989.173386:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cce00 already unused, calling callback (ffffffffc1d48c20) 00000100:00100000:1.0:1788329989.173387:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:8494:x1875199750342272:12345-0@lo:104: Request processed in 50us (451us total) trans 0 rc 0/0 10000000:00010000:3.0:1788329989.173390:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329989.173400:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1788329989.173404:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329989.173412:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329989.173418:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788329989.173440:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173446:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329989.173480:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173487:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cce00/0x91094de4de9aa684 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa68b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173497:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788329989.173500:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173505:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468148ae00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788329989.173508:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173553:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788329989.173560:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788329989.173566:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788329989.173584:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173590:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788329989.173596:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173614:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468148ae00/0x91094de4de9aa606 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa60d expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.173634:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329989.173636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788329989.173640:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329989.173640:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750342528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788329989.173674:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329989.173705:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788329989.173711:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750342656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788329989.173730:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329989.174233:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750342016:0@lo:104: 00000100:00100000:2.0:1788329989.174243:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750342144:0@lo:104: 00000100:00100000:2.0:1788329989.174263:0:8494:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8494:1875199750342272:0@lo:104: 00010000:00010000:2.0:1788329989.174287:0:8494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329989.174386:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329989.175067:0:5828:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:0.0:1788329989.175223:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750342400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788329989.181633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329989.183596:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342528 00000100:00100000:0.0:1788329989.183609:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342528 00010000:00010000:0.0:1788329989.183729:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa684 expref: 19 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788329989.183798:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342656 00000100:00100000:0.0:1788329989.183802:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342656 00010000:00010000:0.0:1788329989.183814:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa606 expref: 20 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329989.186443:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342400 00000100:00100000:1.0:1788329989.186460:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342400 00010000:00010000:1.0:1788329989.186505:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa6df expref: 21 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329989.186570:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788329989.186581:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+21:3312:x1875199750342528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788329989.186598:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788329989.186604:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa684 expref: 21 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186616:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa684 expref: 21 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186636:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cc800/0x91094de4de9aa68b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa684 expref: 21 pid: 5837 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186653:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788329989.186742:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3312:x1875199750342528:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (13066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329989.186749:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788329989.186769:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788329989.186776:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750342656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788329989.186784:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788329989.186789:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa606 expref: 19 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186797:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa606 expref: 19 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186807:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214f400/0x91094de4de9aa60d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa606 expref: 19 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186828:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788329989.186854:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:3312:x1875199750342656:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (13122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329989.186860:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788329989.186873:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788329989.186879:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3315:x1875199750342400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788329989.186886:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788329989.186890:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa6df expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186901:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa6df expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186911:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c20cdc00/0x91094de4de9aa6e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa6df expref: 17 pid: 5838 timeout: 394 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186923:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186932:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186949:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186956:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186962:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186974:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186980:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788329989.186984:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.186992:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.187006:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329989.187016:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788329989.187046:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3315:x1875199750342400:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (5426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329989.187064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788329989.187113:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750342400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788329989.187147:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750342656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788329989.187156:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750342528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788329989.199231:0:8494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.199254:0:8494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329989.199261:0:8494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214e600/0x91094de4de9aa844 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329989.797271:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329990.302996:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788329990.303019:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750342784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788329990.303105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.303174:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342784 00000100:00100000:1.0:1788329990.303181:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342784 00000100:00100000:1.0:1788329990.303233:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788329990.303241:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750342784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788329990.303284:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788329990.303328:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750342784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.303336:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788329990.303356:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788329990.303384:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469b7c6a00 x1875199750342784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329990.303405:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750342784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788329990.660899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329990.666033:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342336 00000100:00100000:1.0:1788329990.666060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342336 00000100:00100000:2.0:1788329990.677003:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 174 00000100:00100000:2.0:1788329990.677030:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:5591:x1875199729342336:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788329990.677060:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788329990.677081:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ea99 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.677113:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.677124:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.677133:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214f800, rc 0) 00000100:00100000:2.0:1788329990.677211:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342336:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 185us (16324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329990.677219:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 174 00000100:00100000:0.0:1788329990.689071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329990.689168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342464 00000100:00100000:1.0:1788329990.689180:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342464 00000100:00100000:1.0:1788329990.689247:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 175 00000100:00100000:1.0:1788329990.689259:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342464:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.689626:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342464:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 367us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.689635:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 175 00000100:00100000:1.0:1788329990.693300:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329990.693416:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342592 00000100:00100000:0.0:1788329990.693428:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342592 00000100:00100000:0.0:1788329990.693497:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 176 00000100:00100000:0.0:1788329990.693508:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342592:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788329990.693825:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:5591:x1875199729342592:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 318us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329990.693834:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 176 00000100:00100000:1.0:1788329990.703836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329990.705627:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342720 00000100:00100000:3.0:1788329990.705645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342720 00000100:00100000:3.0:1788329990.705716:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 177 00000100:00100000:3.0:1788329990.705726:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:6127:x1875199729342720:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788329990.705989:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:6127:x1875199729342720:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 262us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329990.705997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 177 00000100:00100000:0.0:1788329990.715249:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329990.715343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342848 00000100:00100000:1.0:1788329990.715355:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342848 00000100:00100000:1.0:1788329990.715417:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 178 00000100:00100000:1.0:1788329990.715428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:6127:x1875199729342848:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788329990.715738:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:6127:x1875199729342848:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 311us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.715756:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 178 00010000:00010000:0.0:1788329990.818554:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788329990.822240:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788329990.822248:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954682f55000 from 4 10000000:01000000:3.0:1788329990.822254:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788329990.822307:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329990.822320:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329990.822332:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329990.822361:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750342912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788329990.822454:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329990.822575:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788329990.827651:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750342912 00000100:00100000:0.0:1788329990.827680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750342912 00000100:00100000:0.0:1788329990.827765:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788329990.827776:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750342912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788329990.827793:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329990.827813:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa852 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329990.827845:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa852 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329990.827856:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa852 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329990.827864:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680030800, rc 0) 00000100:00100000:0.0:1788329990.827947:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750342912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (5493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329990.827954:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788329990.829112:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750342912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788329990.829197:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788329990.829211:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788329990.829291:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788329990.829343:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788329990.829384:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788329990.836243:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343040 00000100:00100000:0.0:1788329990.836262:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343040 00000100:00100000:0.0:1788329990.836329:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788329990.836341:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750343040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788329990.836705:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750343040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (7361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329990.836714:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788329990.836787:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788329990.836839:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788329990.836887:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329990.836916:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b780c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329990.837108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343168 00000100:00100000:1.0:1788329990.837114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343168 00000100:00100000:1.0:1788329990.837150:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788329990.837157:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750343168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.837318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750343168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.837324:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788329990.837959:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788329990.838384:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8565:1875199750343296:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329990.838439:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329990.838476:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b786c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329990.838705:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343296 00000100:00100000:1.0:1788329990.838711:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343296 00000100:00100000:1.0:1788329990.838943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788329990.838954:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8565:x1875199750343296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788329990.839182:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8565:x1875199750343296:12345-0@lo:502:llog_process_th.0 Request processed in 229us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.839189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788329990.839266:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8565:1875199750343296:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788329990.839292:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788329990.839300:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329990.839302:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788329990.839309:0:8565:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff954682f55000 00000020:00000080:3.0:1788329990.839312:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788329990.839389:0:8565:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8565:1875199750343424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788329990.839425:0:8565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329990.854203:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343424 00000100:00100000:0.0:1788329990.854219:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343424 00000100:00100000:0.0:1788329990.854273:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788329990.854284:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8565:x1875199750343424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329990.854559:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:8565:x1875199750343424:12345-0@lo:502:llog_process_th.0 Request processed in 277us (15132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329990.854567:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788329990.858470:0:8565:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181000 going to sleep for 11 seconds 00000100:00100000:3.0:1788329990.858562:0:8565:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8565:1875199750343424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788329990.858629:0:8565:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788329990.858647:0:8565:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788329990.858650:0:8565:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788329990.858655:0:8565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788329990.860090:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788329990.860117:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788329990.860129:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860141:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788329990.860152:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788329990.860155:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9546a001c800 from 4 10000000:01000000:1.0:1788329990.860158:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788329990.860193:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860206:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860217:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329990.860244:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.860318:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.860366:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343552 00000100:00100000:1.0:1788329990.860374:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343552 00000100:00100000:1.0:1788329990.860418:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788329990.860427:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750343552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788329990.860441:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788329990.860454:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa860 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860478:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa860 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860487:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa860 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860498:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468148bc00, rc 0) 00000100:00100000:1.0:1788329990.860565:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750343552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.860572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788329990.860630:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a005af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788329990.860653:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788329990.860819:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788329990.860828:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788329990.860880:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.860907:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.860928:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343680 00000100:00100000:1.0:1788329990.860932:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343680 00000100:00100000:1.0:1788329990.860953:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788329990.860960:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750343680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.861210:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750343680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.861218:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788329990.861244:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980240 going to sleep for 11 seconds 00000100:00100000:1.0:1788329990.861256:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.861282:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.861317:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.861335:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343808 00000100:00100000:1.0:1788329990.861340:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343808 00000100:00100000:1.0:1788329990.861361:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788329990.861366:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750343808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.861495:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750343808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.861510:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1788329990.861571:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980240 going to sleep for 11 seconds 00000100:00100000:1.0:1788329990.861582:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750343808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788329990.871259:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8567:1875199750343936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788329990.871373:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.871422:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750343936 00000100:00100000:1.0:1788329990.871430:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750343936 00000100:00100000:1.0:1788329990.871477:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788329990.871488:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8567:x1875199750343936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788329990.871976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8567:x1875199750343936:12345-0@lo:502:llog_process_th.0 Request processed in 488us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788329990.871984:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1788329990.872062:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9545849800c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788329990.872084:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8567:1875199750343936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788329990.872114:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788329990.872125:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788329990.872127:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788329990.872137:0:8567:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9546a001c800 00000020:00000080:1.0:1788329990.872140:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788329990.872221:0:8567:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8567:1875199750344064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788329990.872257:0:8567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788329990.872274:0:8567:0:(client.c:2715:ptlrpc_set_wait()) set ffff9545849800c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788329990.881213:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344064 00000100:00100000:2.0:1788329990.881234:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344064 00000100:00100000:2.0:1788329990.881310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788329990.881321:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8567:x1875199750344064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329990.881653:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:8567:x1875199750344064:12345-0@lo:502:llog_process_th.0 Request processed in 334us (9394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329990.881661:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788329990.883627:0:8567:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8567:1875199750344064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788329990.883694:0:8567:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788329990.883706:0:8567:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788329990.883708:0:8567:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788329990.883718:0:8567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788329990.884127:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788329990.884147:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788329990.884158:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.884170:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788329990.884181:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788329990.884183:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954689604000 from 4 10000000:01000000:2.0:1788329990.884186:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788329990.884222:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.884231:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.884241:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329990.884263:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750344192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.884325:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329990.884388:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788329990.885918:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344192 00000100:00100000:0.0:1788329990.885939:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344192 00000100:00100000:0.0:1788329990.885997:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788329990.886008:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750344192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788329990.886025:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788329990.886055:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa86e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329990.886084:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa86e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329990.886096:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa86e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329990.886105:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680031600, rc 0) 00000100:00100000:0.0:1788329990.886166:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750344192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329990.886173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788329990.886305:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750344192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788329990.886323:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.886332:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788329990.886397:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750344320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.886430:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329990.886457:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788329990.886473:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344320 00000100:00100000:2.0:1788329990.886477:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344320 00000100:00100000:2.0:1788329990.886504:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788329990.886510:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750344320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.886895:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750344320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329990.886902:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1788329990.886928:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750344320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.886952:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750344448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.886985:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329990.886998:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788329990.887008:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344448 00000100:00100000:2.0:1788329990.887011:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344448 00000100:00100000:2.0:1788329990.887031:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788329990.887051:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750344448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.887200:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750344448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329990.887206:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788329990.887240:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750344448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788329990.889998:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8570:1875199750344576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329990.890094:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329990.890141:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344576 00000100:00100000:2.0:1788329990.890149:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344576 00000100:00100000:2.0:1788329990.890197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788329990.890208:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:8570:x1875199750344576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329990.890442:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:8570:x1875199750344576:12345-0@lo:502:llog_process_th.0 Request processed in 235us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329990.890451:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788329990.890509:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788329990.890552:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8570:1875199750344576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788329990.890584:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788329990.890595:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329990.890597:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788329990.890605:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff954689604000 00000020:00000080:2.0:1788329990.890607:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788329990.893932:0:8570:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8570:1875199750344704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788329990.894020:0:8570:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329990.894077:0:8570:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788329990.894222:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344704 00000100:00100000:0.0:1788329990.894232:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344704 00000100:00100000:0.0:1788329990.894290:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1788329990.894300:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:8570:x1875199750344704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788329990.894651:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:8570:x1875199750344704:12345-0@lo:502:llog_process_th.0 Request processed in 351us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329990.894660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788329990.896935:0:8570:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:8570:1875199750344704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788329990.896992:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788329990.897015:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788329990.897018:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788329990.897022:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788329990.897106:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788329990.897122:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788329990.897133:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788329990.897144:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788329991.839112:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329992.002167:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329992.002352:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343104 00000100:00100000:0.0:1788329992.002363:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343104 00000100:00100000:0.0:1788329992.002462:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:0.0:1788329992.002474:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729343104:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788329992.002604:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729343104:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 132us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329992.002613:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00080000:2.0:1788329992.003361:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788329992.003719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329992.003801:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788329992.003846:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329992.006181:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343232 00000100:00100000:3.0:1788329992.006225:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343232 00000100:00100000:3.0:1788329992.006314:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343360 00000100:00100000:3.0:1788329992.006318:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343360 00000100:00100000:3.0:1788329992.006349:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788329992.006360:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2349:x1875199729343232:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788329992.006442:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2349:x1875199729343232:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 84us (2641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329992.006450:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788329992.006469:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:3.0:1788329992.006475:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729343360:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788329992.006499:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729343360:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 25us (2653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329992.006506:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00080000:1.0:1788329992.007695:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788329992.007703:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788329992.011204:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729342976 00000100:00100000:2.0:1788329992.011221:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729342976 00000100:00100000:2.0:1788329992.011296:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 194 00000100:00100000:2.0:1788329992.011308:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729342976:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788329992.011396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729342976:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 89us (7679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329992.011404:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 194 00010000:00010000:2.0:1788329992.865125:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329993.376475:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750344832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788329993.376568:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329993.376851:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344832 00000100:00100000:0.0:1788329993.376863:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344832 00000100:00100000:0.0:1788329993.376939:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788329993.376949:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750344832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788329993.376987:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788329993.377074:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750344832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329993.377082:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788329993.377127:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd2680 x1875199750344832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329993.377149:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750344832:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788329993.378376:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788329993.379108:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750345088:0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.379167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329993.379220:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788329993.379227:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750344960:0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.379256:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329993.379281:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750345472:0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.379302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329993.379330:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345088 00000100:00100000:0.0:1788329993.379336:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345088 00000100:00100000:0.0:1788329993.379373:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345472 00000100:00100000:0.0:1788329993.379376:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345472 00000100:00100000:0.0:1788329993.379417:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788329993.381312:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750345088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.381439:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750345088:12345-0@lo:400:kworker.0 Request processed in 2000us (2256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329993.381452:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788329993.381496:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788329993.381509:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750345472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.381558:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750345472:12345-0@lo:400:kworker.0 Request processed in 54us (2255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329993.381565:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788329993.381597:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750344960 00000100:00100000:0.0:1788329993.381605:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750344960 00000100:00100000:0.0:1788329993.381826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1788329993.381836:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750344960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.381870:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750344960:12345-0@lo:400:kworker.0 Request processed in 37us (2613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329993.381876:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00080000:0.0:1788329993.381912:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329993.381930:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750345344:0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.381965:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329993.381996:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788329993.382003:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750345216:0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.382036:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329993.382163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345216 00000100:00100000:0.0:1788329993.382168:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345216 00000100:00100000:0.0:1788329993.382265:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788329993.382272:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750345216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329993.382316:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750345216:12345-0@lo:400:kworker.0 Request processed in 45us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329993.382323:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788329993.382338:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788329993.382365:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750345216:0@lo:400:kworker.0 00000100:00100000:3.0:1788329993.382771:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345344 00000100:00100000:3.0:1788329993.382777:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345344 00000100:00100000:3.0:1788329993.382826:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788329993.382833:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750345344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788329993.382879:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750345344:12345-0@lo:400:kworker.0 Request processed in 47us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329993.382886:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788329993.382920:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd3800 x1875199750345344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788329993.382942:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750345344:0@lo:400:kworker.0 00000100:00080000:0.0:1788329993.383133:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788329993.383372:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750344960:0@lo:400:kworker.0 00000100:00100000:2.0:1788329993.383388:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750345472:0@lo:400:kworker.0 00000100:00100000:2.0:1788329993.383399:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750345088:0@lo:400:kworker.0 00010000:00010000:2.0:1788329993.891153:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788329994.918562:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788329995.424541:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750345600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788329995.424629:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329995.424941:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345600 00000100:00100000:2.0:1788329995.424951:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345600 00000100:00100000:2.0:1788329995.425054:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788329995.425064:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750345600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788329995.425110:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788329995.425426:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750345600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 362us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329995.425434:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788329995.425484:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788329995.425990:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9d500 x1875199750345600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788329995.426036:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750345600:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788329995.935207:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788329996.280141:0:8794:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788329996.958796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329997.121959:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329997.122262:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343488 00000100:00100000:3.0:1788329997.122277:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343488 00000100:00100000:3.0:1788329997.122345:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 196 00000100:00100000:3.0:1788329997.122366:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2346:x1875199729343488:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788329997.122452:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2346:x1875199729343488:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 88us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329997.122459:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 196 00000100:00100000:0.0:1788329997.126113:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788329997.126176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788329997.126280:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343616 00000100:00100000:2.0:1788329997.126294:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343616 00000100:00100000:2.0:1788329997.126392:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:2.0:1788329997.126406:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729343616:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788329997.126510:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729343616:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 107us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329997.126556:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:3.0:1788329997.126600:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343872 00000100:00100000:3.0:1788329997.126606:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343872 00000100:00100000:3.0:1788329997.126651:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:3.0:1788329997.126659:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729343872:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788329997.126709:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729343872:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00080000:0.0:1788329997.126810:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788329997.126815:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788329997.127309:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:0.0:1788329997.130360:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788329997.130542:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729343744 00000100:00100000:3.0:1788329997.130554:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729343744 00000100:00100000:3.0:1788329997.130685:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:3.0:1788329997.130696:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729343744:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788329997.130787:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729343744:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 93us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788329997.130795:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00080000:0.0:1788329997.131159:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788329997.982738:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788329998.496069:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750345728:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496142:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329998.496190:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750346240:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496216:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329998.496243:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788329998.496249:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750345856:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496270:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329998.496288:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750346368:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329998.496368:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750345984:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496403:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329998.496423:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788329998.496428:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750346112:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496449:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788329998.496482:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345728 00000100:00100000:0.0:1788329998.496492:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345728 00000100:00100000:0.0:1788329998.496581:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788329998.496593:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750345728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496755:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750345728:12345-0@lo:400:kworker.0 Request processed in 53us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329998.496765:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788329998.496872:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346240 00000100:00100000:0.0:1788329998.496877:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346240 00000100:00100000:0.0:1788329998.496909:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345856 00000100:00100000:0.0:1788329998.496911:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345856 00000100:00100000:0.0:1788329998.496922:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750345984 00000100:00100000:0.0:1788329998.496925:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750345984 00000100:00100000:0.0:1788329998.496939:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788329998.496944:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750346240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.496988:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750346240:12345-0@lo:400:kworker.0 Request processed in 43us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329998.496995:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788329998.497007:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788329998.497012:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750345856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497041:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750345856:12345-0@lo:400:kworker.0 Request processed in 28us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329998.497047:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788329998.497067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788329998.497073:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750345984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497107:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750345984:12345-0@lo:400:kworker.0 Request processed in 34us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329998.497113:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788329998.497136:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346368 00000100:00100000:0.0:1788329998.497139:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346368 00000100:00100000:0.0:1788329998.497164:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346112 00000100:00100000:0.0:1788329998.497167:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346112 00000100:00100000:0.0:1788329998.497185:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788329998.497191:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750346368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497234:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750346368:12345-0@lo:400:kworker.0 Request processed in 43us (902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329998.497240:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788329998.497251:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788329998.497257:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750346112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497282:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750346112:12345-0@lo:400:kworker.0 Request processed in 26us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788329998.497288:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788329998.497312:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788329998.497315:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788329998.497318:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788329998.497346:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd1180 x1875199750346112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329998.497360:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750346112:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497369:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750345984:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497406:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750345856:0@lo:400:kworker.0 00010000:00080000:0.0:1788329998.497415:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd2680 x1875199750346368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788329998.497424:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750346368:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497431:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750345728:0@lo:400:kworker.0 00000100:00100000:0.0:1788329998.497440:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750346240:0@lo:400:kworker.0 00000100:00100000:2.0:1788329998.497562:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788329998.497571:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750346496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788329998.497598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788329998.497625:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346496 00000100:00100000:2.0:1788329998.497628:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346496 00000100:00100000:2.0:1788329998.497670:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788329998.497678:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750346496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788329998.497706:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788329998.497742:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750346496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788329998.497749:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788329998.497797:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9e680 x1875199750346496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788329998.497810:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750346496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788329999.006712:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330000.031791:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330000.542757:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750346624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330000.542837:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330000.542985:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346624 00000100:00100000:2.0:1788330000.542994:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346624 00000100:00100000:2.0:1788330000.543062:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788330000.543073:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750346624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330000.543107:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330000.543155:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750346624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330000.543162:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788330000.543199:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9e680 x1875199750346624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330000.543217:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750346624:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788330000.543268:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330001.058128:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788330001.576296:0:9038:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing yml_node 00010000:00010000:2.0:1788330002.079636:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330002.253070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330002.253158:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330002.253194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330002.253214:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344128 00000100:00100000:2.0:1788330002.253221:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330002.253226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344128 00000100:00100000:2.0:1788330002.253247:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344256 00000100:00100000:2.0:1788330002.253250:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344256 00000100:00100000:2.0:1788330002.253292:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344384 00000100:00100000:2.0:1788330002.253295:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344384 00000100:00100000:3.0:1788330002.253297:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:3.0:1788330002.253306:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729344128:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330002.253315:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:2.0:1788330002.253322:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2345:x1875199729344256:12345-192.168.202.47@tcp:9:kworker.0 00000020:00000080:2.0:1788330002.253355:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa7b1 00000100:00080000:2.0:1788330002.253364:0:6676:0:(import.c:65:import_set_state_nolock()) ffff954682f51800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788330002.253384:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729344128:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330002.253391:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 41 00000001:00000004:2.0:1788330002.253401:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:3.0:1788330002.253418:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330002.253422:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330002.253424:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330002.253801:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+2:2345:x1875199729344256:12345-192.168.202.47@tcp:9:kworker.0 Request processed in 477us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330002.253809:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:2.0:1788330002.253823:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:2.0:1788330002.253831:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2345:x1875199729344384:12345-192.168.202.47@tcp:9:kworker.0 00000020:00000080:2.0:1788330002.253853:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa7b8 00000100:00080000:2.0:1788330002.253860:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9546a2733000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330002.253889:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:3.0:1788330002.254015:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330002.254116:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+2:2345:x1875199729344384:12345-192.168.202.47@tcp:9:kworker.0 Request processed in 285us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330002.254123:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00010000:00010000:2.0:1788330002.254200:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330002.256393:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344000 00000100:00100000:0.0:1788330002.256408:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344000 00000100:00100000:0.0:1788330002.256504:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 198 00000100:00100000:0.0:1788330002.256514:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729344000:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330002.256603:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729344000:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 91us (3546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330002.256611:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 198 00010000:00010000:3.0:1788330003.103918:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330003.615350:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750346752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330003.615420:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330003.615569:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346752 00000100:00100000:1.0:1788330003.615576:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346752 00000100:00100000:1.0:1788330003.615639:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330003.615649:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750346752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330003.615686:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330003.615736:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750346752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330003.615743:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788330003.616027:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750347136:0@lo:400:kworker.0 00000100:00100000:2.0:1788330003.616056:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330003.616072:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330003.616076:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750347008:0@lo:400:kworker.0 00000100:00100000:2.0:1788330003.616089:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330003.616258:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330003.616269:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347136 00000100:00100000:0.0:1788330003.616272:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347136 00000100:00100000:0.0:1788330003.616307:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347008 00000100:00100000:0.0:1788330003.616309:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347008 00000100:00100000:0.0:1788330003.616318:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330003.616322:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750347136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750347136:12345-0@lo:400:kworker.0 Request processed in 44us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330003.616374:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330003.616390:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330003.616396:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750347008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750347008:12345-0@lo:400:kworker.0 Request processed in 22us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330003.616420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330003.616445:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750347008:0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616452:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750347136:0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616469:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750347264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616486:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788330003.616503:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9ed80 x1875199750346752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330003.616535:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750346752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330003.616543:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788330003.616546:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750346880:0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330003.616578:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750347392:0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.616873:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330003.616975:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750346880 00000100:00100000:0.0:1788330003.616979:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750346880 00000100:00100000:0.0:1788330003.617010:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788330003.617016:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750346880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.617060:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750346880:12345-0@lo:400:kworker.0 Request processed in 43us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330003.617066:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1788330003.617094:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347392 00000100:00100000:0.0:1788330003.617098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347392 00000100:00100000:0.0:1788330003.617116:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330003.617120:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750347392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330003.618577:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750346880:0@lo:400:kworker.0 00000100:00100000:3.0:1788330003.618589:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750347392:0@lo:400:kworker.0 00000100:00100000:0.0:1788330003.619112:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750347392:12345-0@lo:400:kworker.0 Request processed in 20us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330003.619122:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788330003.619200:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347264 00000100:00100000:2.0:1788330003.619205:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347264 00000100:00100000:2.0:1788330003.619245:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330003.619251:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750347264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330003.619315:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750347264:12345-0@lo:400:kworker.0 Request processed in 64us (2828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330003.619331:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1788330003.619350:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330003.619354:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788330003.620070:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc00e00 x1875199750347264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330003.620081:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750347264:0@lo:400:kworker.0 00010000:00010000:2.0:1788330004.126820:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330005.151616:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330005.232050:0:9230:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00000100:00100000:2.0:1788330005.673273:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750347520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330005.673349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330005.674276:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347520 00000100:00100000:1.0:1788330005.674286:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347520 00000100:00100000:1.0:1788330005.674359:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330005.674370:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750347520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330005.674435:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330005.674498:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750347520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330005.674506:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788330005.674778:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330005.674813:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2c380 x1875199750347520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330005.674832:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750347520:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1788330005.739835:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:3.0:1788330005.739845:0:7629:0:(genops.c:885:class_export_put()) final put ffff954682f50800/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:3.0:1788330005.739874:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff954682f50800/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-OST0001 00000020:00000080:3.0:1788330005.739931:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546a2733000 for lustre-OST0001 00010000:00010000:0.0:1788330006.175739:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788330006.743021:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:1.0:1788330006.743031:0:6702:0:(genops.c:885:class_export_put()) final put ffff954682f55800/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:3.0:1788330006.745066:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff954682f55800/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-OST0000 00000020:00000080:3.0:1788330006.745143:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff954682f51800 for lustre-OST0000 00010000:00010000:3.0:1788330007.199205:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330007.366810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330007.366862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330007.367035:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344512 00000100:00100000:1.0:1788330007.367045:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344512 00000100:00100000:1.0:1788330007.367102:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 200 00000100:00100000:1.0:1788330007.367112:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729344512:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330007.367181:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729344512:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 71us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330007.367189:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 200 00000100:00100000:2.0:1788330007.367284:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344640 00000100:00100000:2.0:1788330007.367288:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344640 00000100:00100000:2.0:1788330007.367340:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:2.0:1788330007.367349:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729344640:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330007.367381:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729344640:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 34us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330007.367388:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00080000:1.0:1788330007.367971:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788330007.738007:0:9330:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00010000:00010000:0.0:1788330008.224360:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330008.734936:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330008.734959:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750347648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330008.735023:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330008.735414:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750347904:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735467:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330008.735491:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788330008.735496:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750347776:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735557:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330008.735578:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735597:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330008.735616:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750348032:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735633:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330008.735644:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330008.735648:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750348160:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735672:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330008.735696:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347904 00000100:00100000:1.0:1788330008.735702:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347904 00000100:00100000:1.0:1788330008.735733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348288 00000100:00100000:1.0:1788330008.735735:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348288 00000100:00100000:1.0:1788330008.735753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348032 00000100:00100000:1.0:1788330008.735755:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348032 00000100:00100000:1.0:1788330008.735768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788330008.735775:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750347904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735818:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750347904:12345-0@lo:400:kworker.0 Request processed in 43us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330008.735825:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788330008.735840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788330008.735845:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750348288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735879:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750348288:12345-0@lo:400:kworker.0 Request processed in 21us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330008.735885:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788330008.735895:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330008.735900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750348032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735925:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750348032:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330008.735930:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330008.735944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347776 00000100:00100000:1.0:1788330008.735947:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347776 00000100:00100000:1.0:1788330008.735965:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1788330008.735970:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750347776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.735992:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750347776:12345-0@lo:400:kworker.0 Request processed in 23us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330008.736003:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00080000:1.0:1788330008.736024:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330008.736049:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750348032:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.736068:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750347776:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.736076:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750348288:0@lo:400:kworker.0 00000100:00100000:1.0:1788330008.736084:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750347904:0@lo:400:kworker.0 00000100:00100000:2.0:1788330008.736362:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750347648 00000100:00100000:2.0:1788330008.736367:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750347648 00000100:00100000:2.0:1788330008.736407:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330008.736414:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750347648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330008.736441:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330008.736486:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750347648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330008.736491:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788330008.736551:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348160 00000100:00100000:2.0:1788330008.736555:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348160 00000100:00100000:2.0:1788330008.736579:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330008.736585:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750348160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330008.736612:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750348160:12345-0@lo:400:kworker.0 Request processed in 27us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330008.736618:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788330008.736734:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff954584b2c380 x1875199750348160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330008.736745:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750348160:0@lo:400:kworker.0 00010000:00080000:0.0:1788330008.736754:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc02d80 x1875199750347648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330008.736766:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750347648:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788330008.737720:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330008.737726:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788330009.247442:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330010.074196:0:9428:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:0.0:1788330010.270873:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330010.783036:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750348416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330010.783128:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330010.783239:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348416 00000100:00100000:1.0:1788330010.783247:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348416 00000100:00080000:2.0:1788330010.783301:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330010.783318:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330010.783329:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750348416:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330010.783337:0:6679:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788330010.783348:0:6679:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788330010.783375:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330010.788426:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750348416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5089us (5288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330010.788441:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788330010.793372:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc27800 x1875199750348416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330010.793401:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750348416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330011.295034:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330011.878173:0:9478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Wed Sep 2 02:20:10 EDT 2026 00010000:00010000:0.0:1788330012.325054:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330012.485212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330012.486826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330012.487902:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344768 00000100:00100000:3.0:1788330012.487917:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344768 00000100:00100000:3.0:1788330012.487994:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 202 00000100:00100000:3.0:1788330012.488005:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729344768:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330012.488097:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729344768:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 93us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330012.488106:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 202 00000100:00100000:2.0:1788330012.489844:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729344896 00000100:00100000:2.0:1788330012.489856:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729344896 00000100:00100000:2.0:1788330012.489988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:2.0:1788330012.489998:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729344896:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330012.490071:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729344896:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 75us (4888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330012.490079:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00080000:1.0:1788330012.491176:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330013.343683:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330013.854940:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750348544:0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.854974:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750348672:0@lo:400:kworker.0 00000100:00100000:0.0:1788330013.855200:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750348928:0@lo:400:kworker.0 00000100:00100000:2.0:1788330013.859813:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750348800:0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.859941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330013.860035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330013.860093:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750349056:0@lo:400:kworker.0 00000100:00100000:1.0:1788330013.860133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330013.860163:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348672 00000100:00100000:1.0:1788330013.860167:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348544 00000100:00100000:3.0:1788330013.860173:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348672 00000100:00100000:1.0:1788330013.860177:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348544 00000100:00100000:3.0:1788330013.860211:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349056 00000100:00100000:3.0:1788330013.860213:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349056 00000100:00100000:1.0:1788330013.860215:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:1.0:1788330013.860224:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750348544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.860236:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788330013.860241:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750348672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.860272:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750348672:12345-0@lo:400:kworker.0 Request processed in 31us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330013.860274:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750348544:12345-0@lo:400:kworker.0 Request processed in 51us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330013.860279:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788330013.860280:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1788330013.860295:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330013.860312:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750349056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330013.860325:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750348544:0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.860338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750349056:12345-0@lo:400:kworker.0 Request processed in 38us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330013.860344:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330013.860345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750349056:0@lo:400:kworker.0 00000100:00080000:3.0:1788330013.860377:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330013.860401:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750348672:0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.860408:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750349184:0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.860876:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330013.860904:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349184 00000100:00100000:3.0:1788330013.860908:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349184 00000100:00100000:3.0:1788330013.860949:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330013.860955:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750349184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330013.860985:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750349184:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330013.860992:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1788330013.861005:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330013.861022:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb1880 x1875199750349184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330013.861032:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750349184:0@lo:400:kworker.0 00000100:00100000:0.0:1788330013.861927:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330013.861964:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330013.861973:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750349312:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330013.861995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330013.862045:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348928 00000100:00100000:0.0:1788330013.862050:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348928 00000100:00100000:0.0:1788330013.862089:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330013.862097:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750348928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330013.862138:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750348928:12345-0@lo:400:kworker.0 Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330013.862145:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788330013.862167:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349312 00000100:00100000:0.0:1788330013.862170:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349312 00000100:00100000:0.0:1788330013.862193:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330013.862199:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750349312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330013.862226:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330013.862257:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750349312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330013.862263:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788330013.862288:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330013.862311:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc27480 x1875199750349312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330013.862326:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750349312:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788330013.862336:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb2300 x1875199750348928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330013.862344:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750348928:0@lo:400:kworker.0 00000100:00100000:2.0:1788330013.862434:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330013.862834:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750348800 00000100:00100000:0.0:1788330013.862839:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750348800 00000100:00100000:0.0:1788330013.862913:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330013.862921:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750348800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330013.862958:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750348800:12345-0@lo:400:kworker.0 Request processed in 38us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330013.862964:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330013.863026:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750348800:0@lo:400:kworker.0 00000100:00080000:1.0:1788330013.863059:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330014.368876:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330015.391492:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330015.902717:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330015.902754:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750349440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330015.902842:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330015.903467:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349440 00000100:00100000:1.0:1788330015.903478:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349440 00000100:00100000:1.0:1788330015.903583:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330015.903595:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750349440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330015.903638:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330015.903722:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750349440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330015.903730:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788330015.903780:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bf4f5500 x1875199750349440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330015.903811:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750349440:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788330015.904824:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330016.418401:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330017.464773:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330017.611490:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330017.611571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330017.611633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345024 00000100:00100000:0.0:1788330017.611643:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345024 00000100:00100000:0.0:1788330017.611703:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 204 00000100:00100000:0.0:1788330017.611716:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2347:x1875199729345024:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330017.611801:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2347:x1875199729345024:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 88us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330017.611820:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 204 00000100:00100000:2.0:1788330017.617940:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345152 00000100:00100000:2.0:1788330017.617955:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345152 00000100:00100000:2.0:1788330017.618033:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:2.0:1788330017.618043:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729345152:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330017.618120:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729345152:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 78us (6637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330017.618140:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00080000:2.0:1788330017.618170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330018.537647:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330018.974717:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750349568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330018.974798:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330018.974909:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349568 00000100:00100000:0.0:1788330018.974917:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349568 00000100:00100000:0.0:1788330018.974989:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330018.975000:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750349568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330018.975034:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330018.975078:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750349568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330018.975084:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788330018.975187:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330018.975216:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bf4f5180 x1875199750349568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330018.975233:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750349568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330018.975706:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750349824:0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.975742:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.975767:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788330018.975785:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750349952:0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.975817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330018.975845:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349824 00000100:00100000:1.0:1788330018.975850:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349824 00000100:00100000:1.0:1788330018.975879:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349952 00000100:00100000:1.0:1788330018.975882:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349952 00000100:00100000:1.0:1788330018.975900:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788330018.975907:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750349824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.975942:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750349824:12345-0@lo:400:kworker.0 Request processed in 35us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.975948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788330018.976037:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750349696:0@lo:400:kworker.0 00000100:00100000:3.0:1788330018.976068:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.976091:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750350208:0@lo:400:kworker.0 00000100:00100000:3.0:1788330018.976113:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.976125:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330018.976132:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330018.976152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330018.976176:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750349696 00000100:00100000:3.0:1788330018.976184:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750349696 00000100:00100000:3.0:1788330018.976212:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788330018.976217:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750349696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330018.976247:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750349696:12345-0@lo:400:kworker.0 Request processed in 30us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.976253:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788330018.976283:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350080 00000100:00100000:3.0:1788330018.976286:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350080 00000100:00100000:3.0:1788330018.976312:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330018.976318:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750350080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330018.976344:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750350080:12345-0@lo:400:kworker.0 Request processed in 26us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330018.976350:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788330018.976367:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330018.976371:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788330018.976388:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc24e00 x1875199750350080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330018.976400:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750350080:0@lo:400:kworker.0 00000100:00100000:3.0:1788330018.976421:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750349696:0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.976596:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350208 00000100:00100000:1.0:1788330018.976600:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350208 00000100:00100000:1.0:1788330018.976623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788330018.976628:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750349952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.976657:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750349952:12345-0@lo:400:kworker.0 Request processed in 29us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.976663:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788330018.976673:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788330018.976679:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750350208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.976706:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750350208:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330018.976712:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788330018.976742:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750349952:0@lo:400:kworker.0 00000100:00100000:1.0:1788330018.976753:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750349824:0@lo:400:kworker.0 00000100:00080000:3.0:1788330018.976841:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330018.976858:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750350208:0@lo:400:kworker.0 00010000:00010000:1.0:1788330019.553308:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330020.575554:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330021.032891:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330021.032920:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750350336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330021.032994:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330021.033110:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350336 00000100:00100000:3.0:1788330021.033120:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350336 00000100:00100000:3.0:1788330021.040200:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788330021.040219:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750350336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330021.040319:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330021.040457:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750350336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 243us (7462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330021.040465:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788330021.042421:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330021.042514:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb0700 x1875199750350336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330021.042571:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750350336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788330021.599020:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330022.630436:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330022.731225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330022.731271:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345408 00000100:00100000:1.0:1788330022.731284:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345408 00000100:00100000:1.0:1788330022.731355:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:1.0:1788330022.731433:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729345408:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330022.731509:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729345408:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330022.731537:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:1.0:1788330022.731586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00080000:2.0:1788330022.732174:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330022.735753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345280 00000100:00100000:3.0:1788330022.735773:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345280 00000100:00100000:3.0:1788330022.735854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 206 00000100:00100000:3.0:1788330022.735865:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2348:x1875199729345280:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330022.735960:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2348:x1875199729345280:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 97us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330022.735967:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 206 00010000:00010000:1.0:1788330023.647633:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330024.094906:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750350592:0@lo:400:kworker.0 00000100:00100000:2.0:1788330024.094940:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750350464:0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.095003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330024.095009:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330024.095069:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750351104:0@lo:400:kworker.0 00000100:00100000:0.0:1788330024.095569:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750350848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330024.099223:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750350976:0@lo:400:kworker.0 00000100:00100000:3.0:1788330024.099629:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350464 00000100:00100000:3.0:1788330024.099639:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350464 00000100:00100000:3.0:1788330024.099691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1788330024.099700:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750350464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.099901:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330024.100835:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330024.100852:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750350720:0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.100898:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330024.101432:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350592 00000100:00100000:1.0:1788330024.101441:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350592 00000100:00100000:1.0:1788330024.101484:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350720 00000100:00100000:1.0:1788330024.101488:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350720 00000100:00100000:1.0:1788330024.101540:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330024.101550:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750350592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.101622:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750350592:12345-0@lo:400:kworker.0 Request processed in 74us (6620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330024.101629:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330024.101647:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788330024.101668:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750350720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.101702:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750350720:12345-0@lo:400:kworker.0 Request processed in 36us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330024.101707:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788330024.101736:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351104 00000100:00100000:1.0:1788330024.101741:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351104 00000100:00100000:1.0:1788330024.101771:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330024.101776:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750351104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.101808:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750351104:12345-0@lo:400:kworker.0 Request processed in 33us (1908us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330024.101813:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330024.101858:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750350720:0@lo:400:kworker.0 00000100:00100000:1.0:1788330024.101870:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc25880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750350592:0@lo:400:kworker.0 00010000:00080000:1.0:1788330024.101883:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc25c00 x1875199750351104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330024.101893:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750351104:0@lo:400:kworker.0 00000100:00100000:3.0:1788330024.105392:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750350464:12345-0@lo:400:kworker.0 Request processed in 5684us (10377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330024.105407:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788330024.105863:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330024.105910:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350976 00000100:00100000:2.0:1788330024.105919:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350976 00000100:00100000:2.0:1788330024.106432:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788330024.106445:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750350976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330024.106509:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750350976:12345-0@lo:400:kworker.0 Request processed in 67us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330024.106542:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1788330024.106736:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330024.106743:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330024.107896:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750350976:0@lo:400:kworker.0 00000100:00100000:2.0:1788330024.107939:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750350464:0@lo:400:kworker.0 00000100:00100000:0.0:1788330024.108815:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330024.110662:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750350848 00000100:00100000:3.0:1788330024.110672:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750350848 00000100:00100000:3.0:1788330024.110739:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330024.110753:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750350848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330024.110824:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750350848:12345-0@lo:400:kworker.0 Request processed in 74us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330024.110830:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750351232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330024.110832:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330024.110880:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788330024.110882:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330024.110945:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc24a80 x1875199750350848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330024.110959:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750350848:0@lo:400:kworker.0 00000100:00100000:3.0:1788330024.111224:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351232 00000100:00100000:3.0:1788330024.111229:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351232 00000100:00100000:3.0:1788330024.112382:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330024.112402:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750351232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330024.112447:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330024.112508:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750351232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (1627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330024.112529:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788330024.114801:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bf4f7800 x1875199750351232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330024.114829:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750351232:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788330024.672211:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330025.694700:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330026.142927:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750351360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330026.143003:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330026.143221:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351360 00000100:00100000:3.0:1788330026.143230:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351360 00000100:00100000:3.0:1788330026.143288:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788330026.143299:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750351360:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330026.143314:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788330026.143342:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330026.143585:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750351360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330026.143593:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788330026.144080:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb2300 x1875199750351360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330026.144104:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750351360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788330026.718759:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330027.475385:0:10108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 02:20:26 (1788330026) === 00010000:00010000:1.0:1788330027.742730:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330027.843724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330027.843779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330027.843927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345664 00000100:00100000:2.0:1788330027.843937:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345664 00000100:00100000:2.0:1788330027.844017:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:2.0:1788330027.844031:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729345664:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330027.844140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729345664:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 113us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330027.844148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:3.0:1788330027.845043:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345536 00000100:00100000:3.0:1788330027.845068:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345536 00000100:00100000:3.0:1788330027.845141:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 208 00000100:00100000:3.0:1788330027.845152:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729345536:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330027.845215:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729345536:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 65us (1530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330027.845223:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 208 00000100:00080000:1.0:1788330027.845429:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330027.995832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330027.996037:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345792 00000100:00100000:3.0:1788330027.996048:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345792 00000100:00100000:3.0:1788330027.996114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 209 00000100:00100000:3.0:1788330027.996124:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:8122:x1875199729345792:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788330027.996185:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330027.996216:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9aa87c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7eaa0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330027.996246:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9aa87c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eaa0 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330027.996257:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9aa87c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eaa0 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330027.996266:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8c00, rc 0) 00000100:00100000:3.0:1788330027.996583:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8122:x1875199729345792:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 458us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330027.996590:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 209 00000100:00100000:0.0:1788330028.012787:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330028.013037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729345920 00000100:00100000:2.0:1788330028.013051:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729345920 00000100:00100000:2.0:1788330028.013115:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 210 00000100:00100000:2.0:1788330028.013125:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8122:x1875199729345920:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788330028.013712:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8122:x1875199729345920:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 586us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330028.013722:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 210 00000100:00100000:2.0:1788330028.019649:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330028.022558:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346048 00000100:00100000:3.0:1788330028.022577:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346048 00000100:00100000:3.0:1788330028.022731:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 211 00000100:00100000:3.0:1788330028.022743:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8122:x1875199729346048:12345-192.168.202.47@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330028.022997:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8122:x1875199729346048:12345-192.168.202.47@tcp:503:mount.lustre.0 Request processed in 255us (3360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330028.023006:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 211 00000100:00100000:1.0:1788330028.033662:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330028.034086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346176 00000100:00100000:2.0:1788330028.034097:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346176 00000100:00100000:2.0:1788330028.034156:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 212 00000100:00100000:2.0:1788330028.034166:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8126:x1875199729346176:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330028.034612:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8126:x1875199729346176:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 445us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330028.034621:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 212 00000100:00100000:0.0:1788330028.052483:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330028.052645:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346304 00000100:00100000:3.0:1788330028.052656:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346304 00000100:00100000:3.0:1788330028.052726:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 213 00000100:00100000:3.0:1788330028.052737:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8126:x1875199729346304:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330028.053024:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8126:x1875199729346304:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 287us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330028.053033:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 213 00000100:00100000:3.0:1788330028.066473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330028.066761:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346432 00000100:00100000:1.0:1788330028.066773:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346432 00000100:00100000:1.0:1788330028.066853:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 214 00000100:00100000:1.0:1788330028.066864:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:8122:x1875199729346432:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788330028.066884:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330028.066905:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508e00/0x91094de4de9aa883 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7eaca expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330028.066937:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508e00/0x91094de4de9aa883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eaca expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330028.066948:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508e00/0x91094de4de9aa883 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eaca expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330028.066958:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508e00, rc 0) 00000100:00100000:1.0:1788330028.067021:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:8122:x1875199729346432:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 159us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330028.067029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 214 00000100:00100000:1.0:1788330028.069705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330028.069806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346560 00000100:00100000:2.0:1788330028.069819:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346560 00000100:00100000:2.0:1788330028.069876:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 215 00000100:00100000:2.0:1788330028.069886:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:8122:x1875199729346560:12345-192.168.202.47@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788330028.069916:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788330028.069942:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788330028.069946:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788330028.069949:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788330028.069952:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788330028.072215:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:8122:x1875199729346560:12345-192.168.202.47@tcp:256:mount.lustre.0 Request processed in 2320us (2519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330028.072229:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 215 00000100:00100000:3.0:1788330028.078495:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330028.081173:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346688 00000100:00100000:0.0:1788330028.081191:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346688 00000100:00100000:0.0:1788330028.081338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 216 00000100:00100000:0.0:1788330028.081365:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:8122:x1875199729346688:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788330028.081393:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330028.081412:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ead1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330028.081452:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330028.081465:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330028.081476:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff954680030000, rc 0) 00000100:00100000:0.0:1788330028.081572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8122:x1875199729346688:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 209us (3089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330028.081580:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 216 00000100:00100000:1.0:1788330028.086059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330028.086147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346816 00000100:00100000:2.0:1788330028.086158:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346816 00000100:00100000:2.0:1788330028.086213:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 217 00000100:00100000:2.0:1788330028.086225:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8122:x1875199729346816:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788330028.087369:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8122:x1875199729346816:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 1141us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330028.087388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 217 00000100:00100000:2.0:1788330028.090000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330028.090085:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729346944 00000100:00100000:3.0:1788330028.090096:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729346944 00000100:00100000:3.0:1788330028.090150:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 218 00000100:00100000:3.0:1788330028.090161:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8122:x1875199729346944:12345-192.168.202.47@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788330028.090435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8122:x1875199729346944:12345-192.168.202.47@tcp:503:mount.lustre.0 Request processed in 275us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330028.090444:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 218 00000100:00100000:3.0:1788330028.093629:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330028.093740:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347072 00000100:00100000:0.0:1788330028.093750:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347072 00000100:00100000:0.0:1788330028.093808:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 219 00000100:00100000:0.0:1788330028.093819:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8130:x1875199729347072:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330028.094069:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8130:x1875199729347072:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 251us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330028.094077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 219 00000100:00100000:2.0:1788330028.095769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330028.097908:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347200 00000100:00100000:1.0:1788330028.097925:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347200 00000100:00100000:2.0:1788330028.098138:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 220 00000100:00100000:2.0:1788330028.098149:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8130:x1875199729347200:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330028.098453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:8130:x1875199729347200:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 306us (2691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330028.098463:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 220 00000100:00100000:3.0:1788330028.102100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330028.102219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347328 00000100:00100000:1.0:1788330028.102231:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347328 00000100:00100000:1.0:1788330028.102296:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:1.0:1788330028.102305:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2345:x1875199729347328:12345-192.168.202.47@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788330028.102344:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 50c20128-def7-404a-9a1d-b928fec28af8@192.168.202.47@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1788330028.102391:0:5846:0:(genops.c:1385:class_connect()) connect: client 50c20128-def7-404a-9a1d-b928fec28af8, cookie 0x91094de4de9aa891 00000004:00100000:1.0:1788330028.102427:0:5846:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788330028.102856:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9546b7a30000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330028.102951:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+6:2345:x1875199729347328:12345-192.168.202.47@tcp:38:mount.lustre.0 Request processed in 645us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330028.102959:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:3.0:1788330028.109348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330028.109511:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347456 00000100:00100000:2.0:1788330028.109557:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347456 00000100:00100000:2.0:1788330028.109632:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:2.0:1788330028.109643:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+6:0:x1875199729347456:12345-192.168.202.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788330028.109694:0:5845:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1788330028.109840:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330028.110793:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330028.110901:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788330028.110915:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788330028.111134:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347584 00000100:00100000:1.0:1788330028.111141:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347584 00000100:00100000:0.0:1788330028.111337:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:0.0:1788330028.111347:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+7:8122:x1875199729347584:12345-192.168.202.47@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788330028.111370:0:10120:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788330028.111555:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+7:0:x1875199729347456:12345-192.168.202.47@tcp:41:mount.lustre.0 Request processed in 1913us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330028.111563:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:0.0:1788330028.112960:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+6:8122:x1875199729347584:12345-192.168.202.47@tcp:41:mount.lustre.0 Request processed in 1608us (2164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330028.112971:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:1.0:1788330028.115995:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330028.116808:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347712 00000100:00100000:0.0:1788330028.116821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347712 00000100:00100000:0.0:1788330028.116875:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:0.0:1788330028.116884:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+6:8122:x1875199729347712:12345-192.168.202.47@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788330028.117022:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+6:8122:x1875199729347712:12345-192.168.202.47@tcp:40:mount.lustre.0 Request processed in 138us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330028.117029:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788330028.123760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330028.123879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330028.123920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330028.124013:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347840 00000100:00100000:1.0:1788330028.124023:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347840 00000100:00100000:1.0:1788330028.124068:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729347968 00000100:00100000:1.0:1788330028.124071:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729347968 00000100:00100000:1.0:1788330028.124091:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:1.0:1788330028.124099:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875199729347840:12345-192.168.202.47@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788330028.124131:0:8194:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 50c20128-def7-404a-9a1d-b928fec28af8@192.168.202.47@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1788330028.124163:0:8194:0:(genops.c:1385:class_connect()) connect: client 50c20128-def7-404a-9a1d-b928fec28af8, cookie 0x91094de4de9aa898 00002000:00100000:1.0:1788330028.124175:0:8194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 50c20128-def7-404a-9a1d-b928fec28af8/ffff9546b7a37800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330028.124202:0:8194:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330028.124482:0:8194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788330028.124514:0:8194:0:(import.c:65:import_set_state_nolock()) ffff9546b7a33000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330028.124614:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50c20128-def7-404a-9a1d-b928fec28af8+6:2345:x1875199729347840:12345-192.168.202.47@tcp:8:mount.lustre.0 Request processed in 514us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330028.124622:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:1.0:1788330028.124641:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:1.0:1788330028.124646:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875199729347968:12345-192.168.202.47@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788330028.124662:0:8194:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 50c20128-def7-404a-9a1d-b928fec28af8@192.168.202.47@tcp t0 exp 0000000000000000 cur 283 last 0 00000020:00000080:1.0:1788330028.124678:0:8194:0:(genops.c:1385:class_connect()) connect: client 50c20128-def7-404a-9a1d-b928fec28af8, cookie 0x91094de4de9aa89f 00002000:00100000:1.0:1788330028.124701:0:8194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 50c20128-def7-404a-9a1d-b928fec28af8/ffff9546b7a33800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330028.124715:0:8194:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330028.124839:0:8194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788330028.124851:0:8194:0:(import.c:65:import_set_state_nolock()) ffff9546b7a31000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330028.124876:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50c20128-def7-404a-9a1d-b928fec28af8+6:2345:x1875199729347968:12345-192.168.202.47@tcp:8:mount.lustre.0 Request processed in 228us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330028.124883:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:0.0:1788330028.126049:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348096 00000100:00100000:0.0:1788330028.126060:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348096 00000100:00100000:0.0:1788330028.126107:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:0.0:1788330028.126116:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50c20128-def7-404a-9a1d-b928fec28af8+6:8122:x1875199729348096:12345-192.168.202.47@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788330028.126189:0:5847:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788330028.126263:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:50c20128-def7-404a-9a1d-b928fec28af8+6:8122:x1875199729348096:12345-192.168.202.47@tcp:33:mount.lustre.0 Request processed in 147us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330028.126271:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00010000:00010000:0.0:1788330028.767338:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330029.214817:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330029.214841:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750351488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330029.214930:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330029.215096:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351488 00000100:00100000:0.0:1788330029.215107:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351488 00000100:00100000:0.0:1788330029.215181:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788330029.215191:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750351488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330029.215215:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330029.215262:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750351488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330029.215283:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1788330029.215384:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330029.215419:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bf4f4000 x1875199750351488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330029.215438:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750351488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330029.218180:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750351616:0@lo:400:kworker.0 00000100:00100000:0.0:1788330029.218248:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330029.220432:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330029.220449:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750351744:0@lo:400:kworker.0 00000100:00100000:0.0:1788330029.220514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330029.222120:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351744 00000100:00100000:2.0:1788330029.222133:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351744 00000100:00100000:2.0:1788330029.222199:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330029.222209:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750351744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330029.222289:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750351744:12345-0@lo:400:kworker.0 Request processed in 81us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330029.222296:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330029.222500:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750351744:0@lo:400:kworker.0 00000100:00100000:3.0:1788330029.222659:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351616 00000100:00100000:3.0:1788330029.222663:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351616 00000100:00100000:3.0:1788330029.222712:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788330029.222720:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750351616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330029.222770:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750351616:12345-0@lo:400:kworker.0 Request processed in 51us (4521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330029.222776:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788330029.222802:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330029.222813:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750352128:0@lo:400:kworker.0 00000100:00100000:3.0:1788330029.222844:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330029.223097:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352128 00000100:00100000:0.0:1788330029.223102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352128 00000100:00100000:0.0:1788330029.223139:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330029.223147:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750352128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330029.223186:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750352128:12345-0@lo:400:kworker.0 Request processed in 41us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330029.223192:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330029.223224:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750352128:0@lo:400:kworker.0 00000100:00080000:0.0:1788330029.223240:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330029.223254:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750351616:0@lo:400:kworker.0 00000100:00100000:2.0:1788330029.223319:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750352000:0@lo:400:kworker.0 00000100:00100000:2.0:1788330029.223350:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330029.223447:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330029.223454:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750351872:0@lo:400:kworker.0 00000100:00100000:2.0:1788330029.223487:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330029.223510:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750351872 00000100:00100000:2.0:1788330029.223514:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750351872 00000100:00100000:2.0:1788330029.223560:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788330029.223566:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750351872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330029.223597:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750351872:12345-0@lo:400:kworker.0 Request processed in 31us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330029.223603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788330029.223625:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750351872:0@lo:400:kworker.0 00000100:00100000:0.0:1788330029.223703:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352000 00000100:00100000:0.0:1788330029.223707:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352000 00000100:00100000:0.0:1788330029.223744:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788330029.223751:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750352000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330029.223789:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750352000:12345-0@lo:400:kworker.0 Request processed in 38us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330029.223794:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788330029.223831:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc3ad80 x1875199750352000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330029.223840:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750352000:0@lo:400:kworker.0 00000100:00080000:0.0:1788330029.223853:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330029.223856:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788330029.790703:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330030.814848:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330031.262767:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330031.262794:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750352256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330031.262912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330031.263022:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352256 00000100:00100000:2.0:1788330031.263031:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352256 00000100:00100000:2.0:1788330031.263102:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788330031.263113:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750352256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330031.263155:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330031.263212:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750352256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330031.263220:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788330031.263283:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc00700 x1875199750352256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330031.263305:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750352256:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330031.263478:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788330031.395090:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50c20128-def7-404a-9a1d-b928fec28af8 00010000:00010000:1.0:1788330031.838831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330032.371328:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 50c20128-def7-404a-9a1d-b928fec28af8 00000001:00100000:2.0:1788330032.407982:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50c20128-def7-404a-9a1d-b928fec28af8 00010000:00010000:0.0:1788330032.864302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330033.476055:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330033.476142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330033.476170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330033.476200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330033.476230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330033.476260:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348480 00000100:00100000:2.0:1788330033.476271:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348480 00000100:00100000:2.0:1788330033.476341:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348352 00000100:00100000:2.0:1788330033.476345:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348352 00000100:00100000:2.0:1788330033.476370:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:2.0:1788330033.476380:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729348480:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330033.476456:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729348480:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330033.476464:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:2.0:1788330033.476482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:2.0:1788330033.476489:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729348352:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330033.476549:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729348352:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 60us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330033.476555:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:2.0:1788330033.476574:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348736 00000100:00100000:2.0:1788330033.476577:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348736 00000100:00100000:2.0:1788330033.476602:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348608 00000100:00100000:2.0:1788330033.476604:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348608 00000100:00100000:2.0:1788330033.476622:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:2.0:1788330033.476627:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729348736:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330033.476666:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729348736:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 38us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330033.476673:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:2.0:1788330033.476685:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:2.0:1788330033.476697:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729348608:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330033.476720:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729348608:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 24us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330033.476726:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00080000:2.0:1788330033.476748:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330033.476752:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330033.476754:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330033.477624:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348224 00000100:00100000:3.0:1788330033.477644:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348224 00000100:00100000:3.0:1788330033.477694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 222 00000100:00100000:3.0:1788330033.477702:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2349:x1875199729348224:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330033.477744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2349:x1875199729348224:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 43us (1698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330033.477751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 222 00010000:00010000:2.0:1788330033.887880:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330033.937836:0:10307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:0.0:1788330034.340571:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750352512:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.340658:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.340723:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750353024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.340747:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.340776:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788330034.340782:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750352384:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.340809:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.340829:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750352896:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.340849:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.340873:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750352768:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.340897:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.340913:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330034.340918:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750352640:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.340942:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.340956:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750353152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330034.340974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330034.341001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352384 00000100:00100000:0.0:1788330034.341021:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352384 00000100:00100000:0.0:1788330034.341105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788330034.341115:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750352384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.341167:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750352384:12345-0@lo:400:kworker.0 Request processed in 53us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330034.341174:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788330034.341206:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353152 00000100:00100000:0.0:1788330034.341210:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353152 00000100:00100000:0.0:1788330034.341240:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788330034.341246:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750353152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330034.341273:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330034.341308:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750353152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330034.341314:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1788330034.341348:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bf4f4000 x1875199750353152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330034.341445:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750353152:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330034.341477:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750352384:0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342013:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353024 00000100:00100000:2.0:1788330034.342018:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353024 00000100:00100000:2.0:1788330034.342055:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352768 00000100:00100000:2.0:1788330034.342058:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352768 00000100:00100000:2.0:1788330034.342079:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330034.342085:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750353024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342129:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750353024:12345-0@lo:400:kworker.0 Request processed in 44us (1381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330034.342135:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330034.342147:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788330034.342152:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750352768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342176:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750352768:12345-0@lo:400:kworker.0 Request processed in 25us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330034.342182:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788330034.342196:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352512 00000100:00100000:2.0:1788330034.342199:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352512 00000100:00100000:2.0:1788330034.342220:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352896 00000100:00100000:2.0:1788330034.342223:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352896 00000100:00100000:2.0:1788330034.342235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750352640 00000100:00100000:2.0:1788330034.342237:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750352640 00000100:00100000:2.0:1788330034.342263:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788330034.342268:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750352512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342298:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750352512:12345-0@lo:400:kworker.0 Request processed in 29us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330034.342303:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788330034.342312:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788330034.342318:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750352896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342341:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750352896:12345-0@lo:400:kworker.0 Request processed in 24us (1492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330034.342346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788330034.342356:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330034.342376:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750352640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342401:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750352640:12345-0@lo:400:kworker.0 Request processed in 40us (1459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330034.342406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1788330034.342429:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330034.342433:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330034.342435:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330034.342464:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750352896:0@lo:400:kworker.0 00000100:00100000:2.0:1788330034.342474:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750352512:0@lo:400:kworker.0 00010000:00080000:2.0:1788330034.342484:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc38000 x1875199750353024/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330034.342494:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750353024:0@lo:400:kworker.0 00000100:00100000:0.0:1788330034.342808:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750352640:0@lo:400:kworker.0 00010000:00080000:0.0:1788330034.342819:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc3b800 x1875199750352768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330034.342829:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750352768:0@lo:400:kworker.0 00010000:00010000:2.0:1788330034.921196:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330035.934770:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330036.387581:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330036.387618:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750353280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330036.387708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330036.387777:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353280 00000100:00100000:2.0:1788330036.387785:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353280 00000100:00100000:2.0:1788330036.387842:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788330036.387851:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750353280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330036.387907:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330036.387953:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750353280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330036.387960:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788330036.387981:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330036.388010:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9d500 x1875199750353280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330036.388028:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750353280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330036.958716:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330037.982831:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330038.601686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330038.601742:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330038.601778:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330038.601953:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348864 00000100:00100000:0.0:1788330038.601967:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348864 00000100:00100000:0.0:1788330038.602051:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 224 00000100:00100000:3.0:1788330038.602061:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330038.602063:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729348864:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330038.602135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330038.602142:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729348864:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 81us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330038.602151:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 224 00000100:00100000:2.0:1788330038.602329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349120 00000100:00100000:2.0:1788330038.602334:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349120 00000100:00100000:2.0:1788330038.602385:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729348992 00000100:00100000:2.0:1788330038.602388:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729348992 00000100:00100000:2.0:1788330038.602415:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 70 00000100:00100000:2.0:1788330038.602423:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729349120:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330038.602463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729349120:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 41us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330038.602470:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 70 00000100:00100000:2.0:1788330038.602484:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 71 00000100:00100000:2.0:1788330038.602498:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729348992:12345-192.168.202.47@tcp:400:kworker.0 00000100:00080000:3.0:1788330038.602546:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330038.602548:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2349:x1875199729348992:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 51us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330038.602555:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 71 00000100:00100000:2.0:1788330038.602575:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349376 00000100:00100000:2.0:1788330038.602578:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349376 00000100:00100000:2.0:1788330038.602631:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349248 00000100:00100000:2.0:1788330038.602634:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349248 00000100:00100000:2.0:1788330038.602651:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:2.0:1788330038.602658:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729349376:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330038.602685:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729349376:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 28us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330038.602692:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:2.0:1788330038.602703:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:2.0:1788330038.602709:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729349248:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330038.602730:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729349248:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 21us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330038.602737:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00080000:3.0:1788330038.602744:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330038.602747:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788330039.007368:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330039.454757:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750353664:0@lo:400:kworker.0 00000100:00100000:3.0:1788330039.454839:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330039.454900:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330039.454907:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750353792:0@lo:400:kworker.0 00000100:00100000:3.0:1788330039.454943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330039.454983:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353664 00000100:00100000:3.0:1788330039.454992:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353664 00000100:00100000:3.0:1788330039.455050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330039.455060:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750353664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330039.455112:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750353664:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330039.455119:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330039.455143:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353792 00000100:00100000:3.0:1788330039.455147:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353792 00000100:00100000:3.0:1788330039.455194:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788330039.455201:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750353792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330039.455245:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750353792:12345-0@lo:400:kworker.0 Request processed in 44us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330039.455252:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788330039.455270:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330039.455481:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750353408:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330039.455584:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750353920:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455609:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330039.455632:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788330039.455638:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750353536:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455660:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330039.455677:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750354048:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455698:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330039.455730:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353408 00000100:00100000:1.0:1788330039.455736:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353408 00000100:00100000:1.0:1788330039.455765:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788330039.455772:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750353408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455817:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750353408:12345-0@lo:400:kworker.0 Request processed in 45us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330039.455823:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1788330039.455852:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353920 00000100:00100000:1.0:1788330039.455856:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353920 00000100:00100000:1.0:1788330039.455879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750353536 00000100:00100000:1.0:1788330039.455881:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750353536 00000100:00100000:1.0:1788330039.455894:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330039.455900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750353920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750353920:12345-0@lo:400:kworker.0 Request processed in 33us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330039.455939:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330039.455950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788330039.455955:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750353536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.455980:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750353536:12345-0@lo:400:kworker.0 Request processed in 25us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330039.455985:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788330039.456005:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354048 00000100:00100000:1.0:1788330039.456009:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354048 00000100:00100000:1.0:1788330039.456034:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330039.456039:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750354048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.456067:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750354048:12345-0@lo:400:kworker.0 Request processed in 29us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330039.456073:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330039.456115:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750353536:0@lo:400:kworker.0 00010000:00080000:1.0:1788330039.456128:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc3ad80 x1875199750354048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330039.456144:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750354048:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.456154:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750353408:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.456162:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750353920:0@lo:400:kworker.0 00010000:00080000:1.0:1788330039.456260:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc38700 x1875199750353792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330039.456269:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750353792:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.456452:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750353664:0@lo:400:kworker.0 00000100:00100000:1.0:1788330039.456470:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750354176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330039.456497:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788330039.457318:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330039.457324:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330039.457547:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354176 00000100:00100000:2.0:1788330039.457555:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354176 00000100:00100000:2.0:1788330039.457615:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788330039.457623:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750354176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330039.457657:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330039.457720:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750354176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330039.457733:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788330039.457771:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9d500 x1875199750354176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330039.457787:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750354176:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788330040.031670:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330041.054868:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330041.513735:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330041.513773:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750354304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330041.513877:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330041.513968:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354304 00000100:00100000:2.0:1788330041.513977:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354304 00000100:00100000:2.0:1788330041.514047:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788330041.514059:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750354304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330041.514103:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330041.514161:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750354304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330041.514169:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788330041.514197:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788330041.514233:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc01f80 x1875199750354304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330041.516088:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750354304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788330042.079207:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330043.103707:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330043.718983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330043.719026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330043.719060:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330043.719093:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330043.719115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330043.719188:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350016 00000100:00100000:3.0:1788330043.719189:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349504 00000100:00100000:3.0:1788330043.719197:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349504 00000100:00100000:2.0:1788330043.719198:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350016 00000100:00100000:2.0:1788330043.719259:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349888 00000100:00100000:3.0:1788330043.719260:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 226 00000100:00100000:2.0:1788330043.719265:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349888 00000100:00100000:3.0:1788330043.719275:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729349504:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330043.719293:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:2.0:1788330043.719319:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729350016:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330043.719349:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729349504:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 77us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330043.719362:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 226 00000100:00100000:2.0:1788330043.719363:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729350016:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 43us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330043.719373:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:2.0:1788330043.719393:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:2.0:1788330043.719401:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729349888:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330043.719427:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729349888:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330043.719433:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330043.719576:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349760 00000100:00100000:3.0:1788330043.719581:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349760 00000100:00100000:1.0:1788330043.719595:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729349632 00000100:00100000:1.0:1788330043.719602:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729349632 00000100:00100000:3.0:1788330043.719621:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:3.0:1788330043.719630:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729349760:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330043.719643:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:1.0:1788330043.719654:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729349632:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330043.719672:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729349760:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 43us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330043.719680:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:1.0:1788330043.719693:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729349632:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 40us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330043.719702:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00080000:2.0:1788330043.719798:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330043.719804:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330043.719806:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788330044.126942:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330044.576342:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750354816:0@lo:400:kworker.0 00000100:00100000:0.0:1788330044.576425:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330044.576494:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330044.576502:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750354688:0@lo:400:kworker.0 00000100:00100000:0.0:1788330044.576559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330044.576582:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750355200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330044.576606:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330044.576643:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354688 00000100:00100000:0.0:1788330044.576651:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354688 00000100:00100000:0.0:1788330044.576711:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330044.576722:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750354688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330044.576771:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750354688:12345-0@lo:400:kworker.0 Request processed in 52us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330044.576778:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330044.576803:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355200 00000100:00100000:0.0:1788330044.576819:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355200 00000100:00100000:0.0:1788330044.576850:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330044.577064:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788330044.577102:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330044.577144:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330044.577167:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330044.577187:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788330044.577193:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750354560:0@lo:400:kworker.0 00000100:00100000:3.0:1788330044.577645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354432 00000100:00100000:3.0:1788330044.577651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354432 00000100:00100000:3.0:1788330044.577685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788330044.577692:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750354432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330044.577732:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750354432:12345-0@lo:400:kworker.0 Request processed in 40us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330044.577738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788330044.577775:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354944 00000100:00100000:3.0:1788330044.577780:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354944 00000100:00100000:3.0:1788330044.577807:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788330044.577814:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750354944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330044.577845:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750354944:12345-0@lo:400:kworker.0 Request processed in 32us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330044.577851:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330044.579009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330044.579052:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750355072:0@lo:400:kworker.0 00000100:00100000:2.0:1788330044.579083:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330044.579129:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750354432:0@lo:400:kworker.0 00000100:00100000:2.0:1788330044.579146:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750354944:0@lo:400:kworker.0 00000100:00100000:2.0:1788330044.579188:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354816 00000100:00100000:1.0:1788330044.579310:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355072 00000100:00100000:1.0:1788330044.579316:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355072 00000100:00100000:1.0:1788330044.579357:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330044.579365:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfa8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750355072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330044.579417:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfa8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750355072:12345-0@lo:400:kworker.0 Request processed in 53us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330044.579431:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330044.579588:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750355200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330044.579622:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330044.579657:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750355200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2801us (3051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330044.579665:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788330044.579686:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330044.579691:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330044.579702:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750354560 00000100:00100000:0.0:1788330044.579705:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354560 00000100:00100000:0.0:1788330044.579725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330044.579732:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750354560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330044.579762:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750354560:12345-0@lo:400:kworker.0 Request processed in 31us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330044.579767:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330044.579822:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750354688:0@lo:400:kworker.0 00010000:00080000:0.0:1788330044.579836:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc38a80 x1875199750355200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330044.579850:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750355200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330044.579950:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750354816 00000100:00100000:2.0:1788330044.579987:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788330044.579995:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750354816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330044.580028:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750354816:12345-0@lo:400:kworker.0 Request processed in 36us (3604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330044.580033:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788330044.580347:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330044.580370:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750354560:0@lo:400:kworker.0 00010000:00080000:3.0:1788330044.580382:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc20e00 x1875199750355072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330044.580391:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750355072:0@lo:400:kworker.0 00010000:00080000:0.0:1788330044.581262:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc20380 x1875199750354816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330044.581275:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750354816:0@lo:400:kworker.0 00010000:00010000:0.0:1788330045.150796:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330046.176382:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330046.628190:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330046.628226:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750355328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330046.628297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330046.628363:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355328 00000100:00100000:3.0:1788330046.628371:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355328 00000100:00100000:3.0:1788330046.628434:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788330046.628444:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750355328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330046.628477:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330046.628565:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750355328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330046.628572:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:3.0:1788330046.628593:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330046.628624:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc3a300 x1875199750355328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330046.628642:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750355328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330047.198793:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330048.224126:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330048.836638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330048.836676:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330048.836704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330048.836728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330048.836757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350144 00000100:00100000:3.0:1788330048.836759:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330048.836770:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350144 00000100:00100000:3.0:1788330048.836788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350272 00000100:00100000:3.0:1788330048.836793:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350272 00000100:00100000:1.0:1788330048.836829:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 228 00000100:00100000:3.0:1788330048.836841:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350400 00000100:00100000:1.0:1788330048.836842:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729350144:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330048.836846:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350400 00000100:00100000:3.0:1788330048.836871:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 80 00000100:00100000:3.0:1788330048.836880:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729350272:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330048.836916:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729350144:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330048.836924:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 228 00000100:00100000:3.0:1788330048.836930:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729350272:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330048.836939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 80 00000100:00100000:3.0:1788330048.836957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:1.0:1788330048.836962:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350528 00000100:00100000:3.0:1788330048.836967:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729350400:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330048.836969:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350528 00000100:00100000:3.0:1788330048.836998:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729350400:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 34us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330048.837001:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350656 00000100:00100000:3.0:1788330048.837006:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:1.0:1788330048.837007:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350656 00000100:00080000:3.0:1788330048.837036:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330048.837040:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00080000:3.0:1788330048.837042:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330048.837047:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330048.837051:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2345:x1875199729350528:12345-192.168.202.47@tcp:9:kworker.0 00000020:00000080:1.0:1788330048.837072:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa898 00000100:00080000:1.0:1788330048.837080:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9546b7a33000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330048.837132:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788330048.837432:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+2:2345:x1875199729350528:12345-192.168.202.47@tcp:9:kworker.0 Request processed in 382us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330048.837440:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:1.0:1788330048.837454:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:1.0:1788330048.837460:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2345:x1875199729350656:12345-192.168.202.47@tcp:9:kworker.0 00000020:00000080:1.0:1788330048.837471:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa89f 00000100:00080000:1.0:1788330048.837476:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9546b7a31000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330048.837510:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788330048.837732:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:50c20128-def7-404a-9a1d-b928fec28af8+2:2345:x1875199729350656:12345-192.168.202.47@tcp:9:kworker.0 Request processed in 270us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330048.837747:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00010000:00010000:1.0:1788330048.837883:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330048.838075:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330049.247130:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330049.697611:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750355584:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.697700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330049.697750:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750356096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.697774:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330049.697928:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788330049.697937:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750355456:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.697972:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330049.697995:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750355968:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.698016:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330049.698046:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750355712:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.698069:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330049.698088:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330049.698093:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750355840:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.700245:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330049.700353:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750356096 00000100:00100000:2.0:1788330049.700366:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750356096 00000100:00100000:2.0:1788330049.700460:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355840 00000100:00100000:2.0:1788330049.700464:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355840 00000100:00100000:2.0:1788330049.700502:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788330049.700515:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750356096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.700623:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750356096:12345-0@lo:400:kworker.0 Request processed in 110us (2845us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330049.700631:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788330049.700651:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788330049.700658:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750355840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.700690:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750355840:12345-0@lo:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330049.700695:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788330049.700725:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355456 00000100:00100000:2.0:1788330049.700729:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355456 00000100:00100000:2.0:1788330049.700756:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788330049.700762:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750355456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.700791:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750355456:12345-0@lo:400:kworker.0 Request processed in 30us (2820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330049.700798:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788330049.700847:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750356224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330049.700880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330049.700904:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750356224 00000100:00100000:0.0:1788330049.700916:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750356224 00010000:00080000:2.0:1788330049.700922:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc22d80 x1875199750355840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330049.700938:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750355840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330049.700943:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788330049.700949:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750356224:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330049.700975:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750355456:0@lo:400:kworker.0 00002000:00000024:0.0:1788330049.700981:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788330049.700988:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc21500 x1875199750356096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330049.700995:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750356096:0@lo:400:kworker.0 00000100:00100000:0.0:1788330049.701023:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750356224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (142us total) trans 0 rc 0/0 00010000:00080000:2.0:1788330049.701027:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd1180 x1875199750356224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330049.701029:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788330049.701040:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750356224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330049.702751:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355584 00000100:00100000:0.0:1788330049.702766:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355584 00000100:00100000:0.0:1788330049.703755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355968 00000100:00100000:0.0:1788330049.703764:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355968 00000100:00100000:0.0:1788330049.703800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750355712 00000100:00100000:0.0:1788330049.703802:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750355712 00000100:00100000:0.0:1788330049.705599:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788330049.705618:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750355584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330049.705762:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750355584:12345-0@lo:400:kworker.0 Request processed in 146us (8059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330049.705770:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788330049.705794:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330049.705800:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750355968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330049.705830:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750355968:12345-0@lo:400:kworker.0 Request processed in 30us (7813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330049.705836:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788330049.705846:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788330049.705851:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750355712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330049.705878:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750355712:12345-0@lo:400:kworker.0 Request processed in 28us (7808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330049.705896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788330049.705996:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330049.706004:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330049.706008:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330049.706368:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750355968:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.706387:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750355584:0@lo:400:kworker.0 00000100:00100000:2.0:1788330049.706433:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750355712:0@lo:400:kworker.0 00010000:00010000:0.0:1788330050.276333:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330050.333230:0:11007:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788330051.295986:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330051.744963:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750356352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330051.745076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330051.745172:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750356352 00000100:00100000:2.0:1788330051.745182:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750356352 00000100:00080000:3.0:1788330051.745252:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330051.745254:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788330051.745265:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750356352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330051.745313:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330051.745373:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750356352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330051.745381:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788330051.747640:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc21880 x1875199750356352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330051.747674:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750356352:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788330051.877384:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50c20128-def7-404a-9a1d-b928fec28af8 00000020:00000080:1.0:1788330051.877400:0:7629:0:(genops.c:885:class_export_put()) final put ffff9546b7a33800/50c20128-def7-404a-9a1d-b928fec28af8 00000020:00000080:3.0:1788330051.878325:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546b7a33800/50c20128-def7-404a-9a1d-b928fec28af8 for lustre-OST0001 00000020:00000080:3.0:1788330051.879655:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546b7a31000 for lustre-OST0001 00010000:00010000:0.0:1788330052.319258:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330052.941422:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50c20128-def7-404a-9a1d-b928fec28af8 00000020:00000080:3.0:1788330052.941437:0:6702:0:(genops.c:885:class_export_put()) final put ffff9546b7a37800/50c20128-def7-404a-9a1d-b928fec28af8 00000020:00000080:0.0:1788330052.941551:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546b7a37800/50c20128-def7-404a-9a1d-b928fec28af8 for lustre-OST0000 00000020:00000080:0.0:1788330052.941621:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546b7a33000 for lustre-OST0000 00010000:00010000:1.0:1788330053.342776:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330053.958317:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330053.958371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330053.958404:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330053.958470:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350912 00000100:00100000:2.0:1788330053.958482:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350912 00000100:00100000:2.0:1788330053.958568:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351040 00000100:00100000:2.0:1788330053.958572:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351040 00000100:00100000:2.0:1788330053.958597:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:2.0:1788330053.958607:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729350912:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330053.958686:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729350912:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 78us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330053.958709:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:2.0:1788330053.958726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:2.0:1788330053.958732:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729351040:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330053.958759:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729351040:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 27us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330053.958765:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00080000:3.0:1788330053.960023:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330053.961488:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729350784 00000100:00100000:1.0:1788330053.961501:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729350784 00000100:00100000:1.0:1788330053.963437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 230 00000100:00100000:1.0:1788330053.963467:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729350784:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330053.963567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729350784:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 108us (5195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330053.963576:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 230 00000020:00000080:2.0:1788330054.339930:0:11155:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6431c4e0 20000000:00000080:2.0:1788330054.339947:0:11155:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff95469b549c00 uarg=0000000000000000 20000000:01000000:2.0:1788330054.339982:0:11155:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788330054.339987:0:11155:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788330054.339993:0:11155:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788330054.341043:0:11156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788330054.344712:0:11155:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788330054.356963:0:11155:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788330054.356994:0:11155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357015:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357025:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa852 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357032:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa860 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357039:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa86e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357068:0:11155:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357075:0:11155:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357121:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357200:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 12 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.357218:0:11155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356480:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330054.357367:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa86e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357375:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa86e expref: 18 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.357383:0:11155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356608:0@lo:104: 00000100:00100000:2.0:1788330054.357420:0:11155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330054.357463:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa860 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357471:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa860 expref: 18 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.357479:0:11155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356736:0@lo:104: 00000100:00100000:2.0:1788330054.357509:0:11155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330054.357591:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa852 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357599:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa852 expref: 18 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.357607:0:11155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356864:0@lo:104: 00000100:00100000:2.0:1788330054.357628:0:11155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330054.357649:0:11155:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.357658:0:11155:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 12 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.357666:0:11155:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356992:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330054.357690:0:11155:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb713c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330054.357738:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750356608 00000100:00100000:1.0:1788330054.357746:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750356608 00000100:00100000:1.0:1788330054.357787:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750356736 00000100:00100000:1.0:1788330054.357790:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750356736 00000100:00100000:1.0:1788330054.357800:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750356864 00000100:00100000:1.0:1788330054.357802:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750356864 00000100:00100000:1.0:1788330054.357815:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330054.357822:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:11155:x1875199750356608:12345-0@lo:104: 00010000:00010000:1.0:1788330054.357836:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.357889:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330054.357894:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+5:11155:x1875199750356608:12345-0@lo:104: Request processed in 73us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.357907:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330054.357925:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330054.357931:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:11155:x1875199750356736:12345-0@lo:104: 00010000:00010000:1.0:1788330054.357939:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.357975:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788330054.357981:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:11155:x1875199750356736:12345-0@lo:104: Request processed in 51us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.357987:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788330054.357999:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788330054.358005:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:11155:x1875199750356864:12345-0@lo:104: 00010000:00010000:1.0:1788330054.358013:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358047:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788330054.358052:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:11155:x1875199750356864:12345-0@lo:104: Request processed in 48us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.358057:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788330054.358073:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788330054.358078:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358085:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788330054.358088:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358106:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330054.358113:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330054.358119:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788330054.358152:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358158:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330054.358178:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358184:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c214f400/0x91094de4de9aa86e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa875 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358197:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330054.358201:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358206:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468148b400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788330054.358210:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358216:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330054.358221:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330054.358233:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788330054.358246:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358252:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330054.358258:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358263:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468148b400/0x91094de4de9aa860 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa867 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358273:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330054.358276:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358281:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788330054.358284:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358290:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330054.358295:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330054.358301:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788330054.358312:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358318:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330054.358341:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358348:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9400/0x91094de4de9aa852 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa859 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358361:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330054.358362:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330054.358364:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330054.358377:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750357248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330054.358410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330054.358432:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330054.358450:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750357120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330054.358472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330054.358495:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750357376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330054.358538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330054.358567:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357248 00000100:00100000:1.0:1788330054.358570:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357248 00010000:00010000:1.0:1788330054.358587:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa860 expref: 19 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330054.358606:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357120 00000100:00100000:1.0:1788330054.358609:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357120 00010000:00010000:1.0:1788330054.358620:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa86e expref: 20 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330054.358628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357376 00000100:00100000:1.0:1788330054.358630:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357376 00010000:00010000:1.0:1788330054.358638:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa852 expref: 21 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330054.358662:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330054.358668:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a370050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+21:3315:x1875199750357248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330054.358678:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330054.358684:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa860 expref: 21 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358692:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa860 expref: 21 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358707:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330054.358736:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a370050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+21:3315:x1875199750357248:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.358741:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330054.358784:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330054.358790:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3315:x1875199750357120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330054.358797:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330054.358801:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa86e expref: 20 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358809:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa86e expref: 20 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358818:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330054.358839:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3315:x1875199750357120:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.358845:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330054.358857:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330054.358868:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750357376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330054.358876:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330054.358880:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa852 expref: 19 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358888:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa852 expref: 19 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.358896:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330054.358923:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750357376:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.358929:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330054.358966:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750357376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330054.358990:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750357120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330054.358997:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750357248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330054.359146:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680031600/0x91094de4de9aa875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa86e expref: 18 pid: 5837 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.359158:0:11155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356608:0@lo:104: 00010000:00010000:2.0:1788330054.359167:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468148bc00/0x91094de4de9aa867 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa860 expref: 17 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.359175:0:11155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356736:0@lo:104: 00010000:00010000:2.0:1788330054.359183:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680030800/0x91094de4de9aa859 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa852 expref: 16 pid: 5838 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.359190:0:11155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356864:0@lo:104: 00010000:00010000:0.0:1788330054.360414:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330054.370271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330054.370315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330054.370361:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351168 00000100:00100000:3.0:1788330054.370371:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351168 00010000:00010000:3.0:1788330054.370410:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 13 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330054.370450:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351296 00000100:00100000:3.0:1788330054.370454:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351296 00010000:00010000:3.0:1788330054.370465:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 14 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330054.370482:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330054.370491:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a12fed02-6dfe-42b9-b082-430e8d26c8c5+14:2347:x1875199729351168:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330054.370505:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330054.370512:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 14 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370547:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 14 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370566:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330054.370616:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a12fed02-6dfe-42b9-b082-430e8d26c8c5+14:2347:x1875199729351168:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 126us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330054.370623:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330054.370640:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:3.0:1788330054.370647:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729351296:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330054.370654:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330054.370659:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 13 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370678:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 13 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370691:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370700:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370715:0:8437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370721:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370728:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370735:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370741:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330054.370746:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370754:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370763:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330054.370784:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330054.370807:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729351296:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 158us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330054.370813:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 29 00010000:00010000:2.0:1788330054.370995:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680030000/0x91094de4de9aa88a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ead1 expref: 12 pid: 5838 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.371010:0:11155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356480:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330054.371020:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214f800/0x91094de4de9aa84b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea99 expref: 11 pid: 5839 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330054.371029:0:11155:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11155:1875199750356992:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330054.371063:0:11155:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.371072:0:11155:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.371078:0:11155:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330054.371085:0:11155:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214fe00/0x91094de4de9aa8a6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330054.371898:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330054.821962:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750357632:0@lo:400:kworker.0 00000100:00100000:3.0:1788330054.822042:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330054.822117:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330054.822124:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750357760:0@lo:400:kworker.0 00000100:00100000:3.0:1788330054.822151:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330054.822294:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750357504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330054.822327:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330054.822370:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357632 00000100:00100000:1.0:1788330054.822378:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357632 00000100:00100000:1.0:1788330054.822441:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357504 00000100:00100000:1.0:1788330054.822445:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357504 00000100:00100000:1.0:1788330054.822472:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788330054.822481:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750357632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330054.822608:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750357632:12345-0@lo:400:kworker.0 Request processed in 127us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.822626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788330054.822646:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788330054.822653:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750357504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330054.822690:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750357504:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.822696:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788330054.822714:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330054.823037:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750357632:0@lo:400:kworker.0 00000100:00100000:2.0:1788330054.823130:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750357888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330054.823174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330054.823218:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357888 00000100:00100000:2.0:1788330054.823222:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357888 00000100:00100000:2.0:1788330054.823257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330054.823265:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750357888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330054.823301:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750357888:12345-0@lo:400:kworker.0 Request processed in 37us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.823319:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330054.823339:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750357760 00000100:00100000:2.0:1788330054.823343:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750357760 00000100:00100000:2.0:1788330054.823370:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330054.823376:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750357760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330054.823418:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750357760:12345-0@lo:400:kworker.0 Request processed in 42us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.823424:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788330054.823828:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc3ad80 x1875199750357760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330054.823841:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750357760:0@lo:400:kworker.0 00000100:00080000:1.0:1788330054.824460:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330054.824476:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330054.824551:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750357504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330054.824564:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750358016:0@lo:400:kworker.0 00000100:00100000:1.0:1788330054.824614:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330054.824696:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358016 00000100:00100000:3.0:1788330054.824702:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358016 00000100:00100000:2.0:1788330054.824798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750357888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330054.824952:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788330054.824960:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750358016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330054.825002:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750358016:12345-0@lo:400:kworker.0 Request processed in 43us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330054.825009:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788330054.825090:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788330054.825115:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfb7dc00 x1875199750358016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330054.825131:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750358016:0@lo:400:kworker.0 00000100:00100000:3.0:1788330054.826986:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750358144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330054.827056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330054.827716:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358144 00000100:00100000:1.0:1788330054.827726:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358144 00000100:00100000:1.0:1788330054.827849:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788330054.827862:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750358144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330054.827909:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330054.832595:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750358144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4724us (5527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330054.832610:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788330054.833648:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd0a80 x1875199750358144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330054.833676:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750358144:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788330055.390896:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330055.970616:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330055.970628:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954682f55000 from 7 10000000:01000000:0.0:1788330055.970635:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330055.970695:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.970709:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.970724:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330055.970758:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.970850:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330055.970911:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358272 00000100:00100000:1.0:1788330055.970939:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358272 00000100:00100000:0.0:1788330055.970940:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330055.971002:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788330055.971012:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750358272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330055.971028:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330055.971044:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa8ad expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330055.971072:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330055.971083:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330055.971094:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509c00, rc 0) 00000100:00100000:1.0:1788330055.971157:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750358272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.971165:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788330055.971310:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330055.971327:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.971349:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330055.971415:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.971453:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330055.971476:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f803c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330055.971576:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358400 00000100:00100000:1.0:1788330055.971582:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358400 00000100:00100000:1.0:1788330055.971609:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788330055.971616:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750358400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330055.971930:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750358400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 313us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.971937:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788330055.972597:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330055.972645:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330055.972695:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330055.972719:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4adf600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330055.972808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358528 00000100:00100000:1.0:1788330055.972815:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358528 00000100:00100000:1.0:1788330055.972859:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788330055.972868:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750358528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330055.973117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750358528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.973124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788330055.978349:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788330055.979491:0:11192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788330055.979780:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788330055.979809:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330055.979823:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.979836:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330055.979849:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330055.979852:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9546a001c800 from 7 10000000:01000000:0.0:1788330055.979856:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330055.979905:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.979913:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.979924:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330055.979956:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.980070:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330055.980122:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330055.981286:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358656 00000100:00100000:1.0:1788330055.981302:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358656 00000100:00100000:1.0:1788330055.981371:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788330055.981383:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750358656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330055.981404:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330055.981434:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa8bb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330055.981464:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330055.981476:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330055.981486:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509e00, rc 0) 00000100:00100000:1.0:1788330055.981577:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750358656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.981585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788330055.981719:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330055.981740:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330055.981752:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330055.981849:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.981885:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330055.981924:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330055.982020:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358784 00000100:00100000:2.0:1788330055.982025:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358784 00000100:00100000:2.0:1788330055.982057:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788330055.982065:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750358784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330055.982478:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750358784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 412us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330055.982486:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788330055.982618:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.982657:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.982698:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330055.982729:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330055.983386:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750358912 00000100:00100000:1.0:1788330055.983394:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750358912 00000100:00100000:1.0:1788330055.983439:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1788330055.983449:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750358912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330055.983901:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750358912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 452us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330055.983918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788330055.990451:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750358912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788330055.996890:0:11193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788330055.996997:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788330055.997044:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330055.997071:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330055.997087:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330055.997100:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788330055.997104:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954689604000 from 7 10000000:01000000:3.0:1788330055.997107:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788330055.997170:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330055.997179:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330055.997193:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330055.997228:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750359040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330055.997338:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330055.997405:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330055.997745:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359040 00000100:00100000:2.0:1788330055.997756:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359040 00000100:00100000:2.0:1788330055.997822:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788330055.997834:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750359040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330055.997852:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330055.997869:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aa8c9 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330055.997899:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330055.997912:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330055.997925:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ec00, rc 0) 00000100:00100000:2.0:1788330055.997984:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750359040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330055.997992:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788330055.998078:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750359040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330055.998102:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330055.998113:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330055.998309:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750359168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330055.998469:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330055.998564:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330055.998612:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359168 00000100:00100000:0.0:1788330055.998618:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359168 00000100:00100000:0.0:1788330055.998681:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788330055.998690:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750359168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330055.999051:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750359168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330055.999059:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788330055.999738:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750359168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330055.999798:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750359296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330055.999855:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330055.999898:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb71300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330055.999932:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359296 00000100:00100000:3.0:1788330055.999940:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359296 00000100:00100000:3.0:1788330055.999996:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788330056.000006:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750359296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330056.000753:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750359296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 746us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.000763:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788330056.000779:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750359296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788330056.002014:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788330056.002100:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788330056.002196:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788330056.002210:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.002223:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330056.131739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330056.131851:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351424 00000100:00100000:2.0:1788330056.131867:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351424 00000100:00100000:2.0:1788330056.131953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 240 00000100:00100000:2.0:1788330056.131967:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:5591:x1875199729351424:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330056.131990:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330056.132028:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7eafb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330056.132068:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330056.132083:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330056.132095:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214f400, rc 0) 00000100:00100000:2.0:1788330056.132856:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729351424:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 884us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.132866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 240 00000100:00100000:3.0:1788330056.138881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330056.139062:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351552 00000100:00100000:2.0:1788330056.139077:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351552 00000100:00100000:2.0:1788330056.139157:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 241 00000100:00100000:2.0:1788330056.139168:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729351552:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330056.139604:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729351552:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 435us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330056.139614:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 241 00000100:00100000:0.0:1788330056.145841:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330056.145974:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351680 00000100:00100000:3.0:1788330056.145990:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351680 00000100:00100000:3.0:1788330056.146069:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 242 00000100:00100000:3.0:1788330056.146081:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729351680:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330056.146366:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729351680:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 286us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.146376:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 242 00000100:00100000:0.0:1788330056.155188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330056.155323:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351808 00000100:00100000:3.0:1788330056.155338:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351808 00000100:00100000:3.0:1788330056.155426:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 243 00000100:00100000:3.0:1788330056.155438:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729351808:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330056.155464:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330056.155488:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb02 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.155552:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.155567:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330056.155579:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9000, rc 0) 00000100:00100000:3.0:1788330056.155669:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729351808:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 232us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330056.155678:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 243 00000100:00100000:3.0:1788330056.160766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330056.160898:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729351936 00000100:00100000:0.0:1788330056.160913:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729351936 00000100:00100000:0.0:1788330056.160997:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 244 00000100:00100000:0.0:1788330056.161010:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729351936:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330056.161411:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729351936:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 402us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330056.161431:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 244 00000100:00100000:1.0:1788330056.166717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330056.166868:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352064 00000100:00100000:0.0:1788330056.166886:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352064 00000100:00100000:0.0:1788330056.166989:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 245 00000100:00100000:0.0:1788330056.167002:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729352064:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330056.167327:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729352064:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 326us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330056.167337:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 245 00010000:00010000:1.0:1788330056.414808:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330056.866023:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330056.869296:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750359424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330056.869432:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330056.869658:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359424 00000100:00100000:1.0:1788330056.869671:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359424 00000100:00100000:1.0:1788330056.869749:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788330056.869760:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750359424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330056.869809:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330056.869872:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750359424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330056.869880:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788330056.869906:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330056.869981:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc20a80 x1875199750359424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330056.870006:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750359424:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788330057.440119:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330058.463646:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330059.089950:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330059.090061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330059.090712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330059.090805:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352192 00000100:00100000:2.0:1788330059.090819:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352192 00000100:00100000:2.0:1788330059.090899:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 246 00000100:00100000:2.0:1788330059.090915:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729352192:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330059.091038:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729352192:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 125us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330059.091047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 246 00000100:00100000:3.0:1788330059.098610:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352320 00000100:00100000:3.0:1788330059.098636:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352320 00000100:00100000:3.0:1788330059.098725:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352448 00000100:00100000:3.0:1788330059.098729:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352448 00000100:00100000:3.0:1788330059.098769:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 90 00000100:00100000:3.0:1788330059.098780:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729352320:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330059.098892:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729352320:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 112us (8960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330059.098902:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 90 00000100:00100000:3.0:1788330059.098924:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:3.0:1788330059.098931:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729352448:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330059.098971:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729352448:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 40us (8262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330059.098977:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00080000:3.0:1788330059.098999:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788330059.283855:0:11354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788330059.489340:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330059.934891:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750359552:0@lo:400:kworker.0 00000100:00100000:2.0:1788330059.934977:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750359936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330059.935116:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750359808:0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.935196:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330059.935196:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330059.935303:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750359680:0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.935408:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750360064:0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.936240:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330059.936314:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360064 00000100:00100000:3.0:1788330059.936325:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360064 00000100:00100000:3.0:1788330059.936416:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788330059.936437:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750360064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.937349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750360064:12345-0@lo:400:kworker.0 Request processed in 916us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330059.937362:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788330059.937415:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330059.937682:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750360064:0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.937766:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359936 00000100:00100000:3.0:1788330059.937773:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359936 00000100:00100000:3.0:1788330059.937830:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330059.937839:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750359936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.937896:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750359936:12345-0@lo:400:kworker.0 Request processed in 59us (2708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330059.937902:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788330059.937918:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330059.942772:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330059.942870:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750360320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330059.942920:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330059.943032:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359552 00000100:00100000:0.0:1788330059.943046:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359552 00000100:00100000:0.0:1788330059.943144:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788330059.943154:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750359552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330059.943237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750359552:12345-0@lo:400:kworker.0 Request processed in 83us (8049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330059.943245:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788330059.943447:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359808 00000100:00100000:3.0:1788330059.943452:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359808 00000100:00100000:3.0:1788330059.943502:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788330059.943509:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750359808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.943571:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750359808:12345-0@lo:400:kworker.0 Request processed in 63us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330059.943577:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788330059.943600:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330059.943724:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750359808:0@lo:400:kworker.0 00000100:00100000:0.0:1788330059.943769:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750359552:0@lo:400:kworker.0 00000100:00100000:0.0:1788330059.943814:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360320 00000100:00100000:0.0:1788330059.943818:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360320 00000100:00100000:0.0:1788330059.943866:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788330059.943873:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750360320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330059.943910:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330059.943955:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750360320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330059.943962:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788330059.943997:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbd0e00 x1875199750360320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330059.944032:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750360320:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788330059.944329:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc20e00 x1875199750359936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330059.944340:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750359936:0@lo:400:kworker.0 00000100:00080000:3.0:1788330059.949583:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330059.954458:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330059.954574:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750360192:0@lo:400:kworker.0 00000100:00100000:1.0:1788330059.954636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330059.954829:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750359680 00000100:00100000:3.0:1788330059.954841:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750359680 00000100:00100000:3.0:1788330059.954929:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788330059.954943:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750359680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330059.955039:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750359680:12345-0@lo:400:kworker.0 Request processed in 99us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330059.955048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330059.955288:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360192 00000100:00100000:2.0:1788330059.955294:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360192 00000100:00100000:2.0:1788330059.955341:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788330059.955350:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750360192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330059.955405:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750360192:12345-0@lo:400:kworker.0 Request processed in 57us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330059.955413:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330059.955509:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750359680:0@lo:400:kworker.0 00010000:00080000:1.0:1788330059.955557:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf9f80 x1875199750360192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330075 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330059.955570:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750360192:0@lo:400:kworker.0 00010000:00010000:1.0:1788330060.517953:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330061.534839:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330061.988065:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330061.993449:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750360448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330061.993597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330061.993704:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360448 00000100:00100000:2.0:1788330061.993722:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360448 00000100:00100000:2.0:1788330061.993816:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788330061.993829:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750360448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330061.993870:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788330061.994059:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330061.994447:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750360448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 617us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330061.994456:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1788330061.994691:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf9180 x1875199750360448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330061.994713:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750360448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330062.560676:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330063.041179:0:11453:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 02:21:01 (1788330061) === 00000100:00100000:2.0:1788330063.282702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.282765:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352576 00000100:00100000:3.0:1788330063.282776:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352576 00000100:00100000:3.0:1788330063.282908:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:3.0:1788330063.282921:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729352576:12345-192.168.202.47@tcp:41:mkdir.0 00000004:00000024:3.0:1788330063.282970:0:10120:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788330063.283078:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729352576:12345-192.168.202.47@tcp:41:mkdir.0 Request processed in 159us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.283085:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:2.0:1788330063.283673:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.283781:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352704 00000100:00100000:3.0:1788330063.283789:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352704 00000100:00100000:3.0:1788330063.283830:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:3.0:1788330063.283850:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:9675:x1875199729352704:12345-192.168.202.47@tcp:700:mkdir.0 00000100:00100000:3.0:1788330063.283910:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:9675:x1875199729352704:12345-192.168.202.47@tcp:700:mkdir.0 Request processed in 62us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.283917:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00080000:0.0:1788330063.284530:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330063.285494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.285634:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729352960 00000100:00100000:3.0:1788330063.285643:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729352960 00000100:00100000:3.0:1788330063.285698:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:3.0:1788330063.285709:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:9675:x1875199729352960:12345-192.168.202.47@tcp:36:mkdir.0 00010000:00010000:3.0:1788330063.285995:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330063.286171:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa7c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea84 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.286195:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cc900) 00010000:00010000:3.0:1788330063.286332:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330063.286977:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.286993:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.287004:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.289651:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.289674:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.289720:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330063.294801:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788330063.294821:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.294833:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.294841:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.294848:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.294852:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.294860:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.294878:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cc400) 00010000:00010000:3.0:1788330063.294881:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.294886:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.294891:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330063.294914:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004efc52c3 reply state 0000000093e57bb8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330063.294948:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330063.295712:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9675:x1875199729352960:12345-192.168.202.47@tcp:36:mkdir.0 Request processed in 9997us (10217us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788330063.295724:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00010000:00010000:0.0:1788330063.297434:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.297450:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.297457:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.297463:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330063.297468:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.297476:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.297495:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95468a2cc600) 00010000:00010000:0.0:1788330063.297498:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330063.297546:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.297554:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa8ec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.304083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.304736:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729353088 00000100:00100000:3.0:1788330063.304749:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729353088 00000100:00100000:3.0:1788330063.304915:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788330063.304926:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:9676:x1875199729353088:12345-192.168.202.47@tcp:101:chmod.0 00010000:00010000:3.0:1788330063.304962:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330063.304988:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb09 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.305070:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa8fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.305083:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.305094:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330063.305129:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788330063.305133:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330063.305171:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa8fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.305197:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa8f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb09 expref: 8 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.305237:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa8fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb09 expref: 7 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.305245:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cc400) 00010000:00010000:3.0:1788330063.305248:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330063.305252:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788330063.305328:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9676:x1875199729353088:12345-192.168.202.47@tcp:101:chmod.0 Request processed in 403us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.305335:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:2.0:1788330063.308818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330063.308913:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729353344 00000100:00100000:0.0:1788330063.308922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729353344 00000100:00100000:0.0:1788330063.309123:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:0.0:1788330063.309132:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9676:x1875199729353344:12345-192.168.202.47@tcp:36:chmod.0 00010000:00010000:0.0:1788330063.309182:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330063.309208:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa8fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb09 expref: 7 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.309230:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cc400) 00010000:00010000:0.0:1788330063.309242:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330063.309269:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.309282:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.309291:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330063.309657:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003cfcc51f reply state 0000000039bd423a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330063.309666:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788330063.309675:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788330063.309840:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:9676:x1875199729353344:12345-192.168.202.47@tcp:36:chmod.0 Request processed in 707us (1028us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788330063.309854:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00010000:00010000:3.0:1788330063.312280:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.312302:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.312310:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.312316:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.312321:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.312329:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.312346:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6700) 00010000:00010000:3.0:1788330063.312349:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788330063.312363:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.312383:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aa901 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.339716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330063.342141:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729353472 00000100:00100000:1.0:1788330063.342158:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729353472 00000100:00100000:1.0:1788330063.342237:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:1.0:1788330063.342264:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9677:x1875199729353472:12345-192.168.202.47@tcp:101:chown.0 00010000:00010000:1.0:1788330063.342292:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330063.342323:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9aa908 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb10 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.342409:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508400/0x91094de4de9aa90f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.342425:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508400/0x91094de4de9aa90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.342439:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508400/0x91094de4de9aa90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330063.342480:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788330063.342484:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330063.342564:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508400/0x91094de4de9aa90f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.342594:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9aa908 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb10 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.342615:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508400/0x91094de4de9aa90f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb10 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.342625:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330063.342628:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330063.342632:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508400, rc 0) 00000100:00100000:1.0:1788330063.342710:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:9677:x1875199729353472:12345-192.168.202.47@tcp:101:chown.0 Request processed in 449us (3009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330063.342727:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:2.0:1788330063.347645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.347915:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729353600 00000100:00100000:3.0:1788330063.347930:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729353600 00000100:00100000:3.0:1788330063.348007:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:3.0:1788330063.348018:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:9677:x1875199729353600:12345-192.168.202.47@tcp:101:chown.0 00010000:00010000:3.0:1788330063.348038:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330063.348069:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa916 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb17 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348299:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348325:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348338:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348364:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348372:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348378:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348633:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa92b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348655:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa92b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348663:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa92b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330063.348693:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788330063.348697:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330063.348720:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa92b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348733:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348739:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348745:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348751:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.348756:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348763:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348777:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330063.348780:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.348784:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348801:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa91d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348819:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348824:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348830:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348835:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.348838:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348843:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348851:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95468a2cc900) 00010000:00010000:3.0:1788330063.348854:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.348856:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348862:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa924 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348899:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa916 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb17 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348914:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa92b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb17 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.348927:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95468a2ccb00) 00010000:00010000:3.0:1788330063.348930:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330063.348932:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9e00, rc 0) 00000100:00100000:3.0:1788330063.349663:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:9677:x1875199729353600:12345-192.168.202.47@tcp:101:chown.0 Request processed in 1641us (2195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.349673:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:2.0:1788330063.353890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.354256:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729353856 00000100:00100000:3.0:1788330063.354268:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729353856 00000100:00100000:3.0:1788330063.354718:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:3.0:1788330063.354732:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:9677:x1875199729353856:12345-192.168.202.47@tcp:36:chown.0 00010000:00010000:3.0:1788330063.354793:0:10120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330063.354819:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa92b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb17 expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.354840:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95468a2ccb00) 00010000:00010000:3.0:1788330063.354852:0:10120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330063.354882:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.354895:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.354905:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330063.415963:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788330063.415980:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788330063.416274:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad0b45f4 reply state 000000007271d5e7 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330063.416288:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788330063.416304:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788330063.416532:0:10120:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788330063.416558:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9677:x1875199729353856:12345-192.168.202.47@tcp:36:chown.0 Request processed in 61825us (62673us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788330063.416568:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 20 00010000:00010000:0.0:1788330063.416718:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.416727:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.416735:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.416741:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330063.416746:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.416755:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.416849:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95468a2cc800) 00010000:00010000:0.0:1788330063.416853:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330063.416858:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.416865:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa932 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.437252:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330063.437402:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729353984 00000100:00100000:0.0:1788330063.437414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729353984 00000100:00100000:0.0:1788330063.437525:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:0.0:1788330063.437541:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:9678:x1875199729353984:12345-192.168.202.47@tcp:101:touch.500 00010000:00010000:0.0:1788330063.437621:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330063.437658:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aa939 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb1e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330063.444994:0:5844:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 7280us 00010000:00010000:2.0:1788330063.466178:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.466202:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.466217:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.466235:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.466243:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.466249:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467494:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aa94e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467509:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aa94e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467734:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aa94e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330063.467833:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330063.467837:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330063.467877:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aa94e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467890:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467897:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467905:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467911:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330063.467916:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467925:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467939:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:2.0:1788330063.467942:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330063.467946:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467952:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467977:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467982:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467987:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.467992:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330063.467995:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.468001:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.468009:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff954692606900) 00010000:00010000:2.0:1788330063.468011:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330063.468014:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.468019:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa947 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.468133:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aa939 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb1e expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.468148:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aa94e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb1e expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.468166:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:2.0:1788330063.468169:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788330063.468172:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fe00, rc 0) 00000100:00100000:2.0:1788330063.468473:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9678:x1875199729353984:12345-192.168.202.47@tcp:101:touch.500 Request processed in 30936us (31231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330063.468484:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:2.0:1788330063.471475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330063.474025:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729354240 00000100:00100000:1.0:1788330063.474041:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729354240 00000100:00100000:1.0:1788330063.474115:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:1.0:1788330063.474126:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9678:x1875199729354240:12345-192.168.202.47@tcp:101:touch.500 00010000:00010000:1.0:1788330063.474146:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330063.474167:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aa955 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb25 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.474458:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.474473:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.474484:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.476572:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.476625:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.476643:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330063.478146:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788330063.478635:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9aa96a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478655:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9aa96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478671:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9aa96a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478718:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478726:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478733:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478739:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330063.478745:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478825:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478855:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:1.0:1788330063.478858:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330063.478863:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478869:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa95c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330063.478884:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003a940539 reply state 0000000048c862e0 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330063.478895:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788330063.478946:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aa955 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb25 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478961:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9aa96a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb25 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.478969:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:1.0:1788330063.478972:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330063.478974:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509400, rc 0) 00000100:00100000:1.0:1788330063.479232:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+10:9678:x1875199729354240:12345-192.168.202.47@tcp:101:touch.500 Request processed in 5106us (7766us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788330063.479243:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 22 00010000:00010000:0.0:1788330063.487048:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.487069:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.487078:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.487086:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330063.487093:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.487102:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.487126:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff954689d7f800) 00010000:00010000:0.0:1788330063.487131:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330063.487136:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.487142:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aa963 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.498704:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.498878:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729354496 00000100:00100000:3.0:1788330063.498898:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729354496 00000100:00100000:3.0:1788330063.499049:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:3.0:1788330063.499061:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:9678:x1875199729354496:12345-192.168.202.47@tcp:36:touch.500 00010000:00010000:3.0:1788330063.499123:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330063.499149:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9aa96a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb25 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.499170:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:3.0:1788330063.499179:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330063.499220:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.499232:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.499241:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330063.499386:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c9074b6f reply state 000000002e21354e transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330063.499396:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330063.499495:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+10:9678:x1875199729354496:12345-192.168.202.47@tcp:36:touch.500 Request processed in 436us (809us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788330063.499503:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 23 00010000:00010000:3.0:1788330063.502134:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.502153:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.502162:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.502184:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.502189:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.502197:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.502214:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95468a2cc100) 00010000:00010000:3.0:1788330063.502217:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.502221:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.502226:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa978 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.506066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.506784:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729354624 00000100:00100000:3.0:1788330063.506802:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729354624 00000100:00100000:3.0:1788330063.506890:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:3.0:1788330063.506903:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:9678:x1875199729354624:12345-192.168.202.47@tcp:101:touch.500 00010000:00010000:3.0:1788330063.506938:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330063.506971:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa97f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb2c expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.507061:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa97f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb2c expref: 10 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.507086:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa97f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb2c expref: 10 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.507137:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95468a2ccb00) 00010000:00010000:3.0:1788330063.507141:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330063.507146:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8a00, rc 0) 00000100:00100000:3.0:1788330063.507231:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+10:9678:x1875199729354624:12345-192.168.202.47@tcp:101:touch.500 Request processed in 329us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.507238:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:1.0:1788330063.514654:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.515634:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729354752 00000100:00100000:3.0:1788330063.515654:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729354752 00000100:00100000:3.0:1788330063.515732:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788330063.515957:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875199729354752:12345-192.168.202.47@tcp:8:touch.500 00010000:00080000:3.0:1788330063.516003:0:6676:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 318 last 0 00000020:00000080:3.0:1788330063.516285:0:6676:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9aa986 00002000:00100000:3.0:1788330063.516302:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a815e47-382d-4064-91e8-23b9de97ce7e/ffff95468a4d0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788330063.516331:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788330063.518223:0:6676:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788330063.518291:0:6676:0:(import.c:65:import_set_state_nolock()) ffff95468a4d1000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330063.518489:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729354752:12345-192.168.202.47@tcp:8:touch.500 Request processed in 2531us (3842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.518503:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:2.0:1788330063.525481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330063.525662:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729354880 00000100:00100000:0.0:1788330063.525678:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729354880 00000100:00080000:3.0:1788330063.525792:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330063.525793:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:0.0:1788330063.525814:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:0:x1875199729354880:12345-192.168.202.47@tcp:2:touch.500 00010000:00010000:1.0:1788330063.583039:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788330063.632778:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1788330063.632830:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000100:00100000:0.0:1788330063.633256:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:0:x1875199729354880:12345-192.168.202.47@tcp:2:touch.500 Request processed in 107436us (107781us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788330063.633271:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:2.0:1788330063.647011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330063.647317:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729355136 00000100:00100000:1.0:1788330063.647333:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729355136 00000100:00100000:1.0:1788330063.647459:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330063.647473:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+10:9678:x1875199729355136:12345-192.168.202.47@tcp:35:touch.500 00000100:00100000:1.0:1788330063.648041:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+11:9678:x1875199729355136:12345-192.168.202.47@tcp:35:touch.500 Request processed in 568us (1044us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788330063.648065:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330063.690545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330063.691359:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729355264 00000100:00100000:2.0:1788330063.691378:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729355264 00000100:00100000:2.0:1788330063.691483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:2.0:1788330063.691496:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+11:9679:x1875199729355264:12345-192.168.202.47@tcp:101:rm.0 00010000:00010000:2.0:1788330063.691578:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330063.691608:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa98d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb33 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.692398:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aa994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.692420:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aa994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.692435:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aa994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330063.692493:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788330063.692498:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330063.692579:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aa994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.692619:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa98d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb33 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.692655:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aa994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb33 expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.692666:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:0.0:1788330063.692669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330063.692674:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface000, rc 0) 00000100:00100000:0.0:1788330063.692776:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+12:9679:x1875199729355264:12345-192.168.202.47@tcp:101:rm.0 Request processed in 1282us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330063.692786:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:2.0:1788330063.706762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330063.706874:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729355520 00000100:00100000:1.0:1788330063.706892:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729355520 00000100:00100000:1.0:1788330063.706985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:1.0:1788330063.706999:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+12:9679:x1875199729355520:12345-192.168.202.47@tcp:101:rm.0 00010000:00010000:1.0:1788330063.707874:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330063.707917:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa99b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb3a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330063.710084:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788330063.710417:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa99b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb3a expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.710439:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330063.710442:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330063.710448:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aa99b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb3a expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330063.710479:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509000, rc 0) 00000100:00100000:1.0:1788330063.710608:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+13:9679:x1875199729355520:12345-192.168.202.47@tcp:101:rm.0 Request processed in 3609us (3862us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788330063.710618:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:2.0:1788330063.717835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330063.718989:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729355648 00000100:00100000:1.0:1788330063.719006:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729355648 00000100:00100000:0.0:1788330063.722860:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:0.0:1788330063.722904:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:9679:x1875199729355648:12345-192.168.202.47@tcp:37:rm.0 00000100:00100000:0.0:1788330063.748037:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:9679:x1875199729355648:12345-192.168.202.47@tcp:37:rm.0 Request processed in 25134us (30201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330063.751310:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:2.0:1788330063.760337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.760587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729355904 00000100:00100000:3.0:1788330063.760604:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729355904 00000100:00100000:3.0:1788330063.760726:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:3.0:1788330063.760738:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+13:9679:x1875199729355904:12345-192.168.202.47@tcp:35:rm.0 00000100:00100000:2.0:1788330063.773136:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d56850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:9679:x1875199729355904:12345-192.168.202.47@tcp:35:rm.0 Request processed in 12380us (12799us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788330063.773165:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:2.0:1788330063.779082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.779251:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729356160 00000100:00100000:3.0:1788330063.779266:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729356160 00000100:00100000:3.0:1788330063.779359:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:3.0:1788330063.779371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+14:9679:x1875199729356160:12345-192.168.202.47@tcp:101:rm.0 00010000:00010000:3.0:1788330063.779422:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330063.779467:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb41 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.779675:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa9b0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.779694:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.779710:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa9b0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330063.779724:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788330063.779981:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb41 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.780008:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa9b0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb41 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.780020:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:3.0:1788330063.780024:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330063.780029:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9200, rc 0) 00000100:00100000:3.0:1788330063.780134:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729356160:12345-192.168.202.47@tcp:101:rm.0 Request processed in 764us (1068us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788330063.780142:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:1.0:1788330063.794146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.794300:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729356288 00000100:00100000:3.0:1788330063.794316:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729356288 00000100:00100000:3.0:1788330063.794430:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330063.794443:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729356288:12345-192.168.202.47@tcp:41:rm.0 00000004:00000024:3.0:1788330063.794564:0:10120:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788330063.794666:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729356288:12345-192.168.202.47@tcp:41:rm.0 Request processed in 225us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.794674:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:2.0:1788330063.799845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.799976:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729356416 00000100:00100000:3.0:1788330063.799993:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729356416 00000100:00100000:3.0:1788330063.800081:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:3.0:1788330063.800094:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729356416:12345-192.168.202.47@tcp:101:rm.0 00010000:00010000:3.0:1788330063.800123:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330063.800151:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb48 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800241:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800261:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800274:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800293:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800317:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800324:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800498:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800507:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800514:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330063.800598:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788330063.800604:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330063.800630:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800647:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800656:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800663:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800670:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800690:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.800695:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800704:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800720:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:3.0:1788330063.800723:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.800729:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800735:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aa9c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800754:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800759:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800766:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800770:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.800773:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800778:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800796:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff95468a2cc100) 00010000:00010000:3.0:1788330063.800799:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.800802:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800808:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aa9cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800851:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb48 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800864:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb48 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.800871:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95468a2ccb00) 00010000:00010000:3.0:1788330063.800874:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330063.800876:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788330063.800957:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+17:9679:x1875199729356416:12345-192.168.202.47@tcp:101:rm.0 Request processed in 865us (1132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330063.800965:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:2.0:1788330063.807949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.808067:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729356672 00000100:00100000:3.0:1788330063.808082:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729356672 00000100:00100000:3.0:1788330063.808168:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:3.0:1788330063.808182:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+17:9679:x1875199729356672:12345-192.168.202.47@tcp:36:rm.0 00010000:00010000:3.0:1788330063.808267:0:10120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788330063.808308:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb48 expref: 17 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.808384:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa97f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb2c expref: 16 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.808398:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff95468a2ccb00) 00010000:00010000:3.0:1788330063.808416:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aa994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb33 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.808426:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:3.0:1788330063.808430:0:10120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330063.811687:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.811723:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.811741:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.811772:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.811779:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.811786:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.812006:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.812014:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.812022:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330063.814901:0:10120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788330063.814925:0:10120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 318727405829ns, next at 319727401600ns, rc = 0 00010000:00010000:2.0:1788330063.815741:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815784:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815800:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815812:0:10120:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815820:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815826:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815901:0:10120:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330063.815937:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815952:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815959:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815966:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330063.815971:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.815980:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816005:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff954692606900) 00010000:00010000:2.0:1788330063.816008:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788330063.816013:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816020:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9aa9e8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816063:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816069:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816074:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816079:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330063.816082:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816088:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816095:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:2.0:1788330063.816098:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330063.816101:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.816106:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aa9da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330063.816130:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000651142f9 reply state 000000002719bbca transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.816141:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330063.816277:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729356672:12345-192.168.202.47@tcp:36:rm.0 Request processed in 8092us (8347us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788330063.816288:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 30 00010000:00010000:3.0:1788330063.829799:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330063.829818:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.829832:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330063.829838:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.829849:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.829875:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff954692606900) 00010000:00010000:3.0:1788330063.829879:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788330063.829884:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.829891:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aa9ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.829923:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330063.829957:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330063.829959:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330063.831179:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330063.831490:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729356928 00000100:00100000:2.0:1788330063.831506:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729356928 00000100:00100000:2.0:1788330063.831617:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:2.0:1788330063.831637:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729356928:12345-192.168.202.47@tcp:35:rm.0 00000100:00100000:2.0:1788330063.831958:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+17:9679:x1875199729356928:12345-192.168.202.47@tcp:35:rm.0 Request processed in 321us (792us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788330063.831967:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00010000:00010000:0.0:1788330063.837190:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.837215:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.837225:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.837232:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330063.837238:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.837247:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.837272:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff954692606f00) 00010000:00010000:0.0:1788330063.837275:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330063.837279:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330063.837286:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9aa9e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330063.844284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330063.844493:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357184 00000100:00100000:3.0:1788330063.844509:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357184 00000100:00100000:3.0:1788330063.844637:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:3.0:1788330063.844652:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+16:9679:x1875199729357184:12345-192.168.202.47@tcp:36:rm.0 00010000:00010000:3.0:1788330063.844772:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788330063.845426:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aa9b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb41 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845455:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aa94e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb1e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845471:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:3.0:1788330063.845488:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508400/0x91094de4de9aa90f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb10 expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845497:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330063.845504:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330063.845562:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845577:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845588:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845600:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845616:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.845633:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.846388:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.846402:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.846411:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330063.858443:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788330063.858493:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.858509:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859470:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859483:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330063.859490:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859550:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859578:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff95468a2cc900) 00010000:00010000:2.0:1788330063.859581:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788330063.859588:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859594:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aaa04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859652:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859659:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859667:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859671:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330063.859675:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859680:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859687:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2ccb00) 00010000:00010000:2.0:1788330063.859689:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330063.859692:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330063.859707:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aa9f6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330063.859729:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e271f909 reply state 000000004e12f260 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330063.859740:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330063.859881:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+15:9679:x1875199729357184:12345-192.168.202.47@tcp:36:rm.0 Request processed in 15226us (15611us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788330063.859893:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 31 00010000:00010000:3.0:1788330063.877406:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.877429:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.877439:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.877446:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330063.877459:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.877470:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.877495:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff95468a2cc100) 00010000:00010000:3.0:1788330063.877574:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330063.877581:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330063.877588:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aa9fd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330064.215138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330064.215201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330064.215271:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357312 00000100:00100000:0.0:1788330064.215286:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330064.215288:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357312 00000100:00100000:2.0:1788330064.215381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 248 00000100:00100000:2.0:1788330064.215395:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729357312:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330064.215577:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729357312:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 123us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330064.215588:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 248 00000100:00100000:1.0:1788330064.215724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357568 00000100:00100000:1.0:1788330064.215729:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357568 00000100:00100000:1.0:1788330064.215799:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 95 00000100:00100000:1.0:1788330064.215808:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729357568:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330064.215850:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729357568:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 44us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330064.215857:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 95 00000100:00100000:3.0:1788330064.215889:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357440 00000100:00100000:3.0:1788330064.215895:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357440 00000100:00100000:3.0:1788330064.215955:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:3.0:1788330064.215964:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729357440:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330064.216000:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729357440:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 38us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330064.216008:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00080000:2.0:1788330064.216034:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788330064.606920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788330065.055141:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319967618474ns, next at 320967614823ns, rc = 0 00000100:00100000:1.0:1788330065.055258:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330065.055302:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750360576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330065.055417:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330065.055990:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750360704:0@lo:400:kworker.0 00000100:00100000:1.0:1788330065.056025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330065.056055:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750361216:0@lo:400:kworker.0 00000100:00100000:1.0:1788330065.056077:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330065.056091:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330065.056095:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750361088:0@lo:400:kworker.0 00000100:00100000:1.0:1788330065.056112:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330065.056262:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750360960:0@lo:400:kworker.0 00000100:00100000:3.0:1788330065.056298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330065.056321:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330065.056327:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750360832:0@lo:400:kworker.0 00000100:00100000:3.0:1788330065.056364:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330065.056465:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750361216 00000100:00100000:3.0:1788330065.056476:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750361216 00000100:00100000:1.0:1788330065.056682:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360960 00000100:00100000:1.0:1788330065.056686:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360960 00000100:00100000:1.0:1788330065.056739:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360832 00000100:00100000:1.0:1788330065.056743:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360832 00000100:00100000:1.0:1788330065.056763:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788330065.056773:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750360960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330065.056860:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750360960:12345-0@lo:400:kworker.0 Request processed in 88us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330065.056868:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788330065.056887:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788330065.056894:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750360832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330065.056920:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750360832:12345-0@lo:400:kworker.0 Request processed in 27us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330065.056926:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788330065.057020:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788330065.057028:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750361216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330065.057069:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750361216:12345-0@lo:400:kworker.0 Request processed in 43us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330065.057076:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788330065.057094:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330065.057137:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750360832:0@lo:400:kworker.0 00000100:00100000:3.0:1788330065.057159:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750360960:0@lo:400:kworker.0 00000100:00100000:3.0:1788330065.057202:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750361216:0@lo:400:kworker.0 00000100:00100000:2.0:1788330065.057387:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360704 00000100:00100000:2.0:1788330065.057394:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360704 00000100:00100000:2.0:1788330065.057445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788330065.057454:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750360704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330065.057506:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750360704:12345-0@lo:400:kworker.0 Request processed in 48us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330065.057512:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788330065.057578:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750361088 00000100:00100000:2.0:1788330065.057591:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750361088 00000100:00100000:2.0:1788330065.057625:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330065.057632:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750361088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330065.057669:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750361088:12345-0@lo:400:kworker.0 Request processed in 37us (1555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330065.057675:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330065.057884:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750360576 00000100:00100000:0.0:1788330065.057890:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750360576 00000100:00100000:0.0:1788330065.057939:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788330065.057948:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750360576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330065.057970:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330065.058012:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750360576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330065.058019:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788330065.058171:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330065.058175:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330065.058207:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546beff9880 x1875199750361088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330065.058221:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750361088:0@lo:400:kworker.0 00000100:00100000:3.0:1788330065.058233:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750360704:0@lo:400:kworker.0 00010000:00080000:3.0:1788330065.058251:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4f100 x1875199750360576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330065.058282:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750360576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788330065.631914:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330066.654694:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330067.102711:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750361344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330067.102858:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330067.103511:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750361344 00000100:00100000:0.0:1788330067.103694:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750361344 00000100:00100000:0.0:1788330067.103791:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788330067.103805:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750361344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330067.103856:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330067.103936:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750361344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330067.103944:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1788330067.104005:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4f800 x1875199750361344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330067.104390:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330067.104501:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750361344:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330067.678841:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788330068.698609:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788330068.698635:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:2.0:1788330068.698650:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1788330068.698655:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1788330068.698660:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1788330068.698819:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330068.698840:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750361472:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788330068.698915:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330068.699687:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750361472 00000100:00100000:2.0:1788330068.699697:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750361472 00000100:00100000:2.0:1788330068.699772:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788330068.699783:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750361472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788330068.699813:0:8194:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788330068.699851:0:8194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a97c04f, atime: 0x6a97c04f, ctime: 0x6a97c04f, blocks: 0x1 00010000:00010000:2.0:1788330068.699859:0:8194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330068.699875:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1788330068.699880:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330068.699887:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330068.699922:0:8194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330068.700063:0:8194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330068.700073:0:8194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330068.700101:0:8194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330068.700136:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330068.700145:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.700166:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330068.700171:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.700180:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.700198:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.700205:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c22dea4c/0x91094de4de9aaa0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330068.700223:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330068.700225:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330068.700227:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330068.700580:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330068.701100:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750361472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1316us (2183us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788330068.701110:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788330068.701334:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469b7c7480/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788330068.701343:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750361472:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788330068.713330:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330068.742486:0:11604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1788330069.335598:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330069.335635:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330069.335658:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330069.335697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330069.335728:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357824 00000100:00100000:0.0:1788330069.335737:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357824 00000100:00100000:0.0:1788330069.335800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358080 00000100:00100000:0.0:1788330069.335813:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358080 00000100:00100000:0.0:1788330069.335842:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 99 00000100:00100000:0.0:1788330069.335852:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729357824:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330069.335931:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729357824:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 80us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330069.335940:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 99 00000100:00100000:0.0:1788330069.335958:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 100 00000100:00100000:0.0:1788330069.335965:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729358080:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330069.338719:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729358080:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 2742us (3009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330069.338736:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 100 00000100:00100000:0.0:1788330069.338793:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357696 00000100:00100000:0.0:1788330069.338802:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357696 00000100:00100000:0.0:1788330069.338847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 250 00000100:00100000:0.0:1788330069.338857:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729357696:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330069.338904:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729357696:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 49us (3268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330069.338910:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 250 00000100:00100000:0.0:1788330069.338941:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729357952 00000100:00100000:0.0:1788330069.338944:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729357952 00000100:00100000:0.0:1788330069.338984:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:0.0:1788330069.339429:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729357952:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330069.339471:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729357952:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 481us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330069.339479:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00080000:0.0:1788330069.339549:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330069.339553:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330069.728100:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788330069.875502:0:11652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd62cd5cb0 20000000:00000080:1.0:1788330069.875590:0:11652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9546bfd19000 uarg=0000000000000000 20000000:01000000:1.0:1788330069.875631:0:11652:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788330069.875638:0:11652:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788330069.875643:0:11652:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788330069.877124:0:11653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788330069.877380:0:11652:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788330069.888708:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788330069.889154:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788330069.889371:0:11652:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788330069.889403:0:11652:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330069.889432:0:11652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889458:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889488:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889495:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889506:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889515:0:11652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889563:0:11652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889620:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.889642:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 12 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.889664:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361600:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330069.890028:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.890038:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 12 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.890047:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361728:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330069.890102:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.890112:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 18 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.890124:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361856:0@lo:104: 00000100:00100000:1.0:1788330069.890180:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330069.890253:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.890264:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 18 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.890273:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361984:0@lo:104: 00000100:00100000:1.0:1788330069.890308:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330069.890355:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750361856 00000100:00100000:1.0:1788330069.890364:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750361856 00000100:00100000:1.0:1788330069.890417:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750361984 00000100:00100000:1.0:1788330069.890420:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750361984 00000100:00100000:1.0:1788330069.890436:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330069.890448:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:11652:x1875199750361856:12345-0@lo:104: 00010000:00010000:1.0:1788330069.890466:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.890565:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330069.890572:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+4:11652:x1875199750361856:12345-0@lo:104: Request processed in 126us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330069.890580:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788330069.890609:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788330069.890614:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:11652:x1875199750361984:12345-0@lo:104: 00010000:00010000:1.0:1788330069.890623:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.890663:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788330069.890668:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:11652:x1875199750361984:12345-0@lo:104: Request processed in 55us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330069.890675:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:1.0:1788330069.890711:0:11652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.890720:0:11652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 18 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.890890:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330069.890907:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.890931:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788330069.890936:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.890947:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330069.890976:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330069.890983:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788330069.891297:0:11652:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750362112:0@lo:104: 00000100:00100000:1.0:1788330069.891355:0:11652:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788330069.891359:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.891369:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330069.891398:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.891406:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9a00/0x91094de4de9aa8c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8d0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.891418:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1788330069.891430:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788330069.891436:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362112 00010000:00010000:3.0:1788330069.891437:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.891448:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362112 00010000:00010000:3.0:1788330069.891450:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788330069.891457:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.891465:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330069.891474:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330069.891479:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788330069.891494:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330069.891507:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:11652:x1875199750362112:12345-0@lo:104: 00010000:00010000:1.0:1788330069.891561:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.891607:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330069.891613:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8e6450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+3:11652:x1875199750362112:12345-0@lo:104: Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330069.891622:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788330069.891709:0:11652:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330069.891988:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361856:0@lo:104: 00000100:00100000:1.0:1788330069.892016:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361984:0@lo:104: 00000100:00100000:1.0:1788330069.892023:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750362112:0@lo:104: 00010000:00010000:3.0:1788330069.892405:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.892419:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330069.892432:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.892439:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9aa8bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8c2 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.892457:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330069.892461:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.892467:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacea00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788330069.892470:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.892477:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330069.892484:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330069.892489:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788330069.892706:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750362240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330069.892783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330069.892853:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330069.892859:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750362368:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330069.892891:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330069.892911:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362240 00000100:00100000:1.0:1788330069.892923:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362240 00000100:00100000:2.0:1788330069.892963:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362368 00010000:00010000:1.0:1788330069.892971:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 19 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330069.892977:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362368 00010000:00010000:2.0:1788330069.893022:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 20 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330069.893072:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330069.893093:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3312:x1875199750362368:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330069.893100:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788330069.893116:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+20:3312:x1875199750362240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330069.893146:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330069.893149:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330069.893157:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 20 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330069.893165:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 20 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.893188:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 20 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330069.893352:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 20 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330069.893377:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a509e00/0x91094de4de9aa8c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa8bb expref: 20 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330069.893400:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330069.893463:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750362368:12345-0@lo:103:ldlm_bl.0 Request processed in 378us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330069.893472:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330069.893577:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750362368:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330069.893596:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330069.893675:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214ec00/0x91094de4de9aa8d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa8c9 expref: 18 pid: 5838 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.893693:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330069.893890:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.893902:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3312:x1875199750362240:12345-0@lo:103:ldlm_bl.0 Request processed in 787us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330069.893920:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:3.0:1788330069.893925:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788330069.893999:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750362496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330069.894040:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330069.894094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362496 00000100:00100000:1.0:1788330069.894103:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362496 00010000:00010000:3.0:1788330069.894114:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.894133:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 17 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.894170:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9aa8ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aa8b4 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.894220:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330069.894223:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330069.894225:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330069.894390:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788330069.894401:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a371850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3314:x1875199750362496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330069.894413:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330069.894420:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 17 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.894430:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 17 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.894445:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a509c00/0x91094de4de9aa8b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aa8ad expref: 17 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330069.894457:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330069.894558:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750362240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330069.902416:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361600:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330069.902432:0:11652:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11652:1875199750361728:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330069.902470:0:11652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330069.903462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a371850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3314:x1875199750362496:12345-0@lo:103:ldlm_bl.0 Request processed in 9050us (9407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330069.903482:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330069.905374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330069.905426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330069.905478:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358336 00000100:00100000:3.0:1788330069.905493:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358336 00000100:00100000:0.0:1788330069.905534:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750362496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330069.905576:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 13 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330069.905626:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358208 00000100:00100000:3.0:1788330069.905629:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358208 00010000:00010000:3.0:1788330069.905645:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 14 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330069.905674:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:0.0:1788330069.905769:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+14:2346:x1875199729358336:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330069.905789:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330069.905799:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 14 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330069.905812:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 14 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330069.905831:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214f400/0x91094de4de9aa8d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eafb expref: 14 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330069.905849:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330069.906154:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729358336:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 391us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330069.906201:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:3.0:1788330069.906225:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729358208:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330069.906240:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330069.906248:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 13 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906264:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 13 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906283:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d9000/0x91094de4de9aa8de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb02 expref: 13 pid: 5839 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906330:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906339:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906360:0:8437:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906367:0:8437:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906375:0:8437:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906383:0:8437:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906395:0:8437:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330069.906400:0:8437:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906412:0:8437:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906430:0:8437:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330069.906443:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330069.906496:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:2346:x1875199729358208:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 277us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330069.906511:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 34 00010000:00010000:2.0:1788330069.906704:0:11652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330069.906717:0:11652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330069.906724:0:11652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a509600/0x91094de4de9aaa12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330069.918435:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:0.0:1788330070.177322:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750362624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177430:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177506:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750363136:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177559:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177613:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330070.177619:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750363008:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177649:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177685:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750362880:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177725:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750363392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330070.177746:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177763:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330070.177767:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750362752:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177800:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750363264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177817:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330070.177847:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362624 00000100:00100000:0.0:1788330070.177857:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362624 00000100:00100000:0.0:1788330070.177920:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788330070.177932:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3315:x1875199750362624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.177996:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3315:x1875199750362624:12345-0@lo:400:kworker.0 Request processed in 65us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.178005:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788330070.178045:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363136 00000100:00100000:0.0:1788330070.178048:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363136 00000100:00100000:0.0:1788330070.178084:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362880 00000100:00100000:0.0:1788330070.178087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362880 00000100:00100000:0.0:1788330070.178100:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750362752 00000100:00100000:0.0:1788330070.178102:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750362752 00000100:00100000:0.0:1788330070.178114:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788330070.178121:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750363136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750363136:12345-0@lo:400:kworker.0 Request processed in 42us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.178168:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788330070.178183:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788330070.178188:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750362880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178218:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750362880:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.178224:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788330070.178236:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330070.178241:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750362752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178269:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750362752:12345-0@lo:400:kworker.0 Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.178275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788330070.178314:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363008 00000100:00100000:0.0:1788330070.178318:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363008 00000100:00100000:0.0:1788330070.178347:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363264 00000100:00100000:0.0:1788330070.178350:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363264 00000100:00100000:0.0:1788330070.178373:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330070.178379:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750363008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178413:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750363008:12345-0@lo:400:kworker.0 Request processed in 34us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.178419:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330070.178430:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788330070.178435:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750363264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178458:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750363264:12345-0@lo:400:kworker.0 Request processed in 24us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.178473:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788330070.178505:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330070.178510:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330070.178512:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330070.178585:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750362752:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178596:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750363264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178605:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750362880:0@lo:400:kworker.0 00010000:00080000:0.0:1788330070.178646:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4df80 x1875199750363008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330070.178657:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750363008:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178665:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750362624:0@lo:400:kworker.0 00000100:00100000:0.0:1788330070.178676:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750363136:0@lo:400:kworker.0 00000100:00100000:2.0:1788330070.179213:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363392 00000100:00100000:2.0:1788330070.179222:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363392 00000100:00100000:2.0:1788330070.179341:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330070.179350:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750363392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330070.179392:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330070.179564:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750363392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.179572:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330070.179628:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750363392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788330070.751163:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330070.978490:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330070.978959:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358464 00000100:00100000:2.0:1788330070.978977:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358464 00000100:00100000:2.0:1788330070.979068:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 252 00000100:00100000:2.0:1788330070.979082:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:5591:x1875199729358464:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330070.979106:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330070.979134:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546c214e600/0x91094de4de9aaa19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb4f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.979178:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546c214e600/0x91094de4de9aaa19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb4f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.979194:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546c214e600/0x91094de4de9aaa19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb4f expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330070.979205:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e600, rc 0) 00000100:00100000:2.0:1788330070.979322:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a6c7d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729358464:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 242us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.979358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 252 00000100:00100000:3.0:1788330070.983681:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330070.983947:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358592 00000100:00100000:0.0:1788330070.983962:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358592 00000100:00100000:0.0:1788330070.984048:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 253 00000100:00100000:0.0:1788330070.984063:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729358592:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330070.984589:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729358592:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 526us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.984600:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 253 00000100:00100000:3.0:1788330070.989748:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330070.990317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358720 00000100:00100000:0.0:1788330070.990329:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358720 00000100:00100000:0.0:1788330070.990741:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 254 00000100:00100000:0.0:1788330070.990755:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729358720:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330070.992184:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729358720:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 1424us (2440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330070.992198:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 254 00000100:00100000:3.0:1788330070.996876:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330070.997013:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358848 00000100:00100000:2.0:1788330070.997035:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358848 00000100:00100000:2.0:1788330070.997142:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 255 00000100:00100000:2.0:1788330070.997157:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:9949:x1875199729358848:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330070.997885:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954682a49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:9949:x1875199729358848:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 727us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330070.997898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 255 00000100:00100000:3.0:1788330071.013675:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330071.013780:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729358976 00000100:00100000:0.0:1788330071.013798:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729358976 00000100:00100000:0.0:1788330071.013882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 256 00000100:00100000:0.0:1788330071.013892:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:9949:x1875199729358976:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330071.015531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:9949:x1875199729358976:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 1617us (1845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.015545:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 256 00000100:00100000:3.0:1788330071.035626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330071.035777:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359104 00000100:00100000:0.0:1788330071.035793:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359104 00000100:00100000:0.0:1788330071.035882:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 257 00000100:00100000:0.0:1788330071.035896:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:5591:x1875199729359104:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330071.035922:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330071.035950:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bfacf000/0x91094de4de9aaa20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb56 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.036002:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bfacf000/0x91094de4de9aaa20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb56 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.036017:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bfacf000/0x91094de4de9aaa20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb56 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.036029:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf000, rc 0) 00000100:00100000:0.0:1788330071.036135:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729359104:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 242us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.036145:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 257 00000100:00100000:3.0:1788330071.040560:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330071.041460:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359232 00000100:00100000:0.0:1788330071.041477:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359232 00000100:00100000:0.0:1788330071.041607:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 258 00000100:00100000:0.0:1788330071.041621:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729359232:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330071.042070:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729359232:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 449us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.042079:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 258 00000100:00100000:3.0:1788330071.048105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330071.048870:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359360 00000100:00100000:2.0:1788330071.048887:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359360 00000100:00100000:2.0:1788330071.048986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 259 00000100:00100000:2.0:1788330071.048999:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729359360:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.050183:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:5591:x1875199729359360:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 1176us (2085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330071.050197:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 259 00000100:00100000:3.0:1788330071.060938:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330071.061051:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359488 00000100:00100000:2.0:1788330071.061071:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359488 00000100:00100000:2.0:1788330071.061165:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 260 00000100:00100000:2.0:1788330071.061179:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:9952:x1875199729359488:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330071.065873:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:9952:x1875199729359488:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 2688us (3350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330071.065895:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 260 00000100:00100000:3.0:1788330071.074813:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330071.077503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359616 00000100:00100000:0.0:1788330071.077542:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359616 00000100:00100000:0.0:1788330071.077645:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 261 00000100:00100000:0.0:1788330071.077658:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:9952:x1875199729359616:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330071.078570:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:9952:x1875199729359616:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 908us (3767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.078583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 261 00010000:00010000:3.0:1788330071.774877:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330071.843014:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330071.843030:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954682f55000 from 7 10000000:01000000:2.0:1788330071.843038:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330071.843160:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330071.843177:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330071.843194:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330071.843240:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750363520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.843374:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330071.843469:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330071.843592:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363520 00000100:00100000:0.0:1788330071.843603:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363520 00000100:00100000:0.0:1788330071.843684:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788330071.843697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:5841:x1875199750363520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330071.843715:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330071.843734:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bfacee00/0x91094de4de9aaa2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aaa27 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.843764:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bfacee00/0x91094de4de9aaa2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aaa27 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.843788:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bfacee00/0x91094de4de9aaa2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aaa27 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.843800:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacee00, rc 0) 00000100:00100000:0.0:1788330071.843863:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750363520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.843871:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788330071.844060:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750363520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330071.844081:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330071.844092:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330071.844168:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750363648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.844200:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330071.844453:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330071.844569:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363648 00000100:00100000:0.0:1788330071.844576:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363648 00000100:00100000:0.0:1788330071.844967:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788330071.844978:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750363648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330071.845665:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750363648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 685us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.845675:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788330071.845866:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750363648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.845928:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750363776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.845991:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.861392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363776 00000100:00100000:1.0:1788330071.861417:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363776 00000100:00100000:1.0:1788330071.862560:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788330071.862585:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750363776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.862988:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750363776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 413us (16994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.862998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788330071.863108:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.863147:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750363776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.863488:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11665:1875199750363904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.863596:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.863633:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750363904 00000100:00100000:1.0:1788330071.863640:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750363904 00000100:00100000:1.0:1788330071.863670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788330071.863680:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:11665:x1875199750363904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.863859:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:11665:x1875199750363904:12345-0@lo:502:llog_process_th.0 Request processed in 180us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.863867:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788330071.863907:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.863920:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11665:1875199750363904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330071.863945:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330071.863957:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330071.863960:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330071.863969:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff954682f55000 00000020:00000080:1.0:1788330071.863972:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788330071.864068:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11665:1875199750364032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.864108:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.864132:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364032 00000100:00100000:1.0:1788330071.864136:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364032 00000100:00100000:1.0:1788330071.864156:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788330071.864163:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:11665:x1875199750364032:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.864296:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:11665:x1875199750364032:12345-0@lo:502:llog_process_th.0 Request processed in 132us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.864305:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788330071.864334:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.864348:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11665:1875199750364032:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330071.864373:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330071.864377:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330071.864379:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788330071.864383:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788330071.864464:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788330071.864489:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330071.864502:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864513:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330071.864556:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330071.864559:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9546a001c800 from 7 10000000:01000000:1.0:1788330071.864562:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330071.864591:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864599:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864609:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330071.864623:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.864651:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.864675:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.864688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364160 00000100:00100000:1.0:1788330071.864692:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364160 00000100:00100000:1.0:1788330071.864714:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788330071.864729:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:5841:x1875199750364160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330071.864740:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330071.864756:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a509800/0x91094de4de9aaa3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aaa35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864783:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a509800/0x91094de4de9aaa3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aaa35 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864796:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a509800/0x91094de4de9aaa3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aaa35 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864807:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509800, rc 0) 00000100:00100000:1.0:1788330071.864838:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750364160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.864844:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788330071.864876:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330071.864891:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.864900:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330071.864943:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.864971:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.864986:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.864997:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364288 00000100:00100000:1.0:1788330071.865001:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364288 00000100:00100000:1.0:1788330071.865018:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788330071.865030:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750364288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.883068:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750364288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 18019us (18077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.883088:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788330071.893990:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330071.894129:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330071.894277:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.894368:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb71000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.894374:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364416 00000100:00100000:1.0:1788330071.894398:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364416 00000100:00100000:1.0:1788330071.894491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788330071.894511:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750364416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.895010:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750364416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 500us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.895019:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788330071.898968:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.905334:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11668:1875199750364544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.905435:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.905504:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788330071.905705:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364544 00000100:00100000:0.0:1788330071.905724:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364544 00000100:00100000:0.0:1788330071.905803:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788330071.905817:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:11668:x1875199750364544:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330071.906692:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:11668:x1875199750364544:12345-0@lo:502:llog_process_th.0 Request processed in 873us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330071.906714:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788330071.907864:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11668:1875199750364544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330071.907917:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330071.907930:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330071.907932:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330071.907939:0:11668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9546a001c800 00000020:00000080:1.0:1788330071.907942:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788330071.908050:0:11668:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11668:1875199750364672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.908147:0:11668:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330071.908198:0:11668:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.908237:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364672 00000100:00100000:1.0:1788330071.908245:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364672 00000100:00100000:1.0:1788330071.908304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1788330071.908320:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:11668:x1875199750364672:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.911241:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:11668:x1875199750364672:12345-0@lo:502:llog_process_th.0 Request processed in 2911us (3083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.911257:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788330071.911426:0:11668:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11668:1875199750364672:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788330071.911474:0:11668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330071.911482:0:11668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330071.911485:0:11668:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788330071.911489:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788330071.911796:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788330071.911818:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330071.911830:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.911842:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330071.911855:0:5841:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330071.911858:0:5841:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954689604000 from 7 10000000:01000000:0.0:1788330071.911861:0:5841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330071.911897:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.911905:0:5841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330071.911916:0:5841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330071.911939:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330071.911996:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.912029:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb716c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.913011:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364800 00000100:00100000:1.0:1788330071.913023:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364800 00000100:00100000:1.0:1788330071.913240:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788330071.913255:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:5841:x1875199750364800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330071.913281:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330071.913300:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508400/0x91094de4de9aaa4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aaa43 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.913334:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508400/0x91094de4de9aaa4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aaa43 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.913346:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508400/0x91094de4de9aaa4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aaa43 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330071.913354:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508400, rc 0) 00000100:00100000:1.0:1788330071.913432:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750364800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330071.916285:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330071.916323:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330071.916336:0:5841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330071.916429:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330071.916506:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330071.916570:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f803c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330071.917827:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750364928 00000100:00100000:2.0:1788330071.917840:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750364928 00000040:00080000:0.0:1788330071.923850:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788330071.929838:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788330071.936542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788330071.936585:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750364928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330071.937230:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750364928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 654us (20720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330071.937242:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788330071.937470:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750364928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.937559:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750365056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330071.937616:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330071.937872:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.947585:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365056 00000100:00100000:1.0:1788330071.947602:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365056 00000100:00100000:1.0:1788330071.947681:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788330071.947692:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750365056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788330071.947992:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:5841:x1875199750365056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 301us (10375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.948007:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788330071.948632:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:5841:1875199750365056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330071.957928:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11671:1875199750365184:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330071.958029:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.958080:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb71a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330071.958142:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365184 00000100:00100000:1.0:1788330071.958151:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365184 00000100:00100000:1.0:1788330071.958205:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788330071.958215:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:11671:x1875199750365184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330071.958466:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:11671:x1875199750365184:12345-0@lo:502:llog_process_th.0 Request processed in 251us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330071.958474:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788330071.958661:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11671:1875199750365184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788330071.958696:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788330071.958707:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788330071.958710:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788330071.958717:0:11671:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff954689604000 00000020:00000080:0.0:1788330071.958720:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788330071.958805:0:11671:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11671:1875199750365312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788330071.958841:0:11671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330071.958864:0:11671:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb71a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330071.960475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365312 00000100:00100000:2.0:1788330071.960492:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365312 00000100:00100000:2.0:1788330071.960559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1788330071.960568:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:11671:x1875199750365312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330071.961177:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b17050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:11671:x1875199750365312:12345-0@lo:502:llog_process_th.0 Request processed in 608us (2333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330071.961186:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788330071.961314:0:11671:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:11671:1875199750365312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330071.961356:0:11671:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330071.961363:0:11671:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330071.961366:0:11671:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788330071.961371:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788330071.961514:0:5841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788330071.961556:0:5841:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330071.961566:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330071.961578:0:5841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330072.224095:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750365440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330072.224209:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330072.224817:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365440 00000100:00100000:0.0:1788330072.224831:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365440 00000100:00100000:0.0:1788330072.225976:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788330072.226031:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750365440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330072.226095:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330072.226220:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750365440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 229us (2010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330072.226229:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788330072.226378:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4df80 x1875199750365440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330072.226410:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750365440:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788330072.226849:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330072.802339:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330072.932063:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788330073.829048:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788330073.875675:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:2.0:1788330074.436701:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330074.436982:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359872 00000100:00100000:0.0:1788330074.437001:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359872 00000100:00100000:0.0:1788330074.437121:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 104 00000100:00100000:0.0:1788330074.437134:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729359872:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330074.437265:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729359872:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 132us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330074.437275:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 104 00000100:00080000:2.0:1788330074.437420:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330074.443656:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330074.443719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330074.443770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330074.443866:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360000 00000100:00100000:1.0:1788330074.443888:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360000 00000100:00100000:2.0:1788330074.443911:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360128 00000100:00100000:2.0:1788330074.443957:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360128 00000100:00100000:2.0:1788330074.444040:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 105 00000100:00100000:1.0:1788330074.444041:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:2.0:1788330074.444071:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729360128:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330074.444071:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729360000:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330074.444217:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729360128:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 159us (443us total) trans 0 rc 0/0 00000100:00080000:3.0:1788330074.444223:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330074.444231:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 105 00000100:00080000:3.0:1788330074.444237:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330074.444455:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729359744 00000100:00100000:0.0:1788330074.444471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729359744 00000100:00100000:0.0:1788330074.444545:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 277 00000100:00100000:0.0:1788330074.444555:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729359744:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330074.445341:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729360000:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 1276us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330074.445352:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:0.0:1788330074.453226:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729359744:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 8649us (9566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330074.453260:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 277 00010000:00010000:0.0:1788330074.847878:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330075.296890:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750365696:0@lo:400:kworker.0 00000100:00100000:3.0:1788330075.297017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330075.297111:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750366208:0@lo:400:kworker.0 00000100:00100000:3.0:1788330075.297144:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330075.297479:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330075.297488:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750365824:0@lo:400:kworker.0 00000100:00100000:3.0:1788330075.297573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330075.297615:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366208 00000100:00100000:3.0:1788330075.297624:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366208 00000100:00100000:3.0:1788330075.297707:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330075.297719:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750366208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330075.297792:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750366208:12345-0@lo:400:kworker.0 Request processed in 75us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330075.297801:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788330075.297832:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330075.297865:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1788330075.297873:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469b7c7480, transno 4294967300 00000100:00100000:3.0:1788330075.297914:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750366208:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298149:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750365568:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298207:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330075.298250:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750366080:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330075.298316:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330075.298323:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750365952:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298349:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330075.298381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365696 00000100:00100000:0.0:1788330075.298386:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365696 00000100:00100000:0.0:1788330075.298424:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365824 00000100:00100000:0.0:1788330075.298427:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365824 00000100:00100000:0.0:1788330075.298450:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366080 00000100:00100000:0.0:1788330075.298453:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366080 00000100:00100000:0.0:1788330075.298469:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330075.298476:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750365696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298545:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750365696:12345-0@lo:400:kworker.0 Request processed in 69us (1529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330075.298553:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330075.298572:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330075.298578:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750365824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298622:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750365824:12345-0@lo:400:kworker.0 Request processed in 44us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330075.298629:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330075.298641:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330075.298647:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750366080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298682:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750366080:12345-0@lo:400:kworker.0 Request processed in 35us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330075.298688:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788330075.298710:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330075.298733:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750366080:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298758:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750365824:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298769:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750365696:0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298815:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365952 00000100:00100000:0.0:1788330075.298820:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365952 00000100:00100000:0.0:1788330075.298853:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330075.298860:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750365952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330075.298906:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750365952:12345-0@lo:400:kworker.0 Request processed in 46us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330075.298914:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788330075.298929:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788330075.298948:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfcfaa00 x1875199750365952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330075.298962:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750365952:0@lo:400:kworker.0 00000100:00100000:2.0:1788330075.299469:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750365568 00000100:00100000:2.0:1788330075.299477:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750365568 00000100:00100000:2.0:1788330075.299539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788330075.299549:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750365568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330075.299607:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750365568:12345-0@lo:400:kworker.0 Request processed in 60us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330075.299614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788330075.299664:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750365568:0@lo:400:kworker.0 00000100:00100000:1.0:1788330075.303068:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330075.303110:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750366336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330075.303292:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330075.303566:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366336 00000100:00100000:0.0:1788330075.303586:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366336 00000100:00100000:0.0:1788330075.303780:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788330075.303795:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750366336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330075.303855:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330075.303931:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750366336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330075.303947:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788330075.304051:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750366336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788330075.870989:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330076.898850:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330077.344547:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330077.344587:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750366464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330077.344688:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330077.345182:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366464 00000100:00100000:0.0:1788330077.345194:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366464 00000100:00100000:0.0:1788330077.345412:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330077.345425:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750366464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330077.345476:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330077.345608:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750366464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 184us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330077.345617:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1788330077.345710:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4dc00 x1875199750366464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330077.345737:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750366464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330077.346229:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788330077.918865:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330078.943099:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330079.558677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330079.558739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330079.558775:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330079.558818:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330079.558857:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360384 00000100:00100000:0.0:1788330079.558870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360384 00000100:00100000:0.0:1788330079.558951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360640 00000100:00100000:0.0:1788330079.558954:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360640 00000100:00100000:0.0:1788330079.558977:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 109 00000100:00100000:0.0:1788330079.558988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729360384:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330079.559105:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729360384:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 117us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330079.559267:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 110 00000100:00100000:2.0:1788330079.559280:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729360640:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330079.559311:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729360640:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 36us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330079.559317:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 109 00000100:00100000:2.0:1788330079.559326:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 110 00000100:00100000:3.0:1788330079.559425:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360512 00000100:00100000:3.0:1788330079.559431:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360512 00000100:00100000:3.0:1788330079.559490:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:3.0:1788330079.559501:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729360512:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330079.559603:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729360512:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 106us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330079.559610:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:1.0:1788330079.560384:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360256 00000100:00100000:1.0:1788330079.560394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360256 00000100:00100000:1.0:1788330079.560454:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 279 00000100:00100000:1.0:1788330079.560464:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729360256:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330079.560562:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729360256:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 99us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330079.560570:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 279 00000100:00080000:3.0:1788330079.560589:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330079.560596:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788330079.968004:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330080.419063:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330080.419173:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330080.419341:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750366848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330080.419381:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330080.426197:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750367104:0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.426286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330080.426320:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330080.426329:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750366976:0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.426377:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750366720:0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.426419:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330080.426461:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750367232:0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.426500:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367104 00000100:00100000:1.0:1788330080.426512:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367104 00000100:00100000:1.0:1788330080.426610:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788330080.426621:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750367104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.426698:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750367104:12345-0@lo:400:kworker.0 Request processed in 77us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330080.426725:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:1.0:1788330080.426756:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330080.426812:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366592 00000100:00100000:1.0:1788330080.426816:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366592 00000100:00100000:1.0:1788330080.426856:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330080.426864:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750366592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330080.426903:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330080.426958:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750366592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (7785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330080.426965:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788330080.426977:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330080.426999:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366720 00000100:00100000:1.0:1788330080.427003:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366720 00000100:00100000:1.0:1788330080.427031:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788330080.427038:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750366720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.427081:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750366720:12345-0@lo:400:kworker.0 Request processed in 44us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330080.427088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1788330080.430298:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788330080.430380:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9c700 x1875199750367104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330080.430401:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750367104:0@lo:400:kworker.0 00000100:00100000:2.0:1788330080.430433:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750366592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330080.430488:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366848 00000100:00100000:2.0:1788330080.430497:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366848 00000100:00100000:2.0:1788330080.430589:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750366976 00000100:00100000:2.0:1788330080.430593:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750366976 00000100:00100000:2.0:1788330080.430629:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788330080.430639:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750366848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330080.430728:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750366848:12345-0@lo:400:kworker.0 Request processed in 89us (11345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330080.430737:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788330080.430756:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330080.430762:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750366976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330080.430794:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750366976:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330080.430801:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1788330080.430825:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330080.430845:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750366976:0@lo:400:kworker.0 00000100:00100000:2.0:1788330080.430874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750366848:0@lo:400:kworker.0 00000100:00100000:2.0:1788330080.430887:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750367360:0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.431429:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330080.431475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330080.431509:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367360 00000100:00100000:0.0:1788330080.431533:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367232 00000100:00100000:0.0:1788330080.431538:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367232 00000100:00100000:0.0:1788330080.431578:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330080.431586:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750367232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330080.431588:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367360 00000100:00100000:3.0:1788330080.431633:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330080.431641:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750367360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330080.437514:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750366720:0@lo:400:kworker.0 00000100:00080000:1.0:1788330080.437629:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330080.454242:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750367232:12345-0@lo:400:kworker.0 Request processed in 22638us (22796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330080.454267:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788330080.454510:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750367232:0@lo:400:kworker.0 00000100:00100000:3.0:1788330080.457532:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750367360:12345-0@lo:400:kworker.0 Request processed in 25856us (26020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330080.457557:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330080.463555:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750367360:0@lo:400:kworker.0 00010000:00010000:0.0:1788330080.991231:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330082.016746:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330082.143366:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788330082.463778:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330082.463820:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750367488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330082.463928:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330082.464201:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367488 00000100:00100000:0.0:1788330082.464214:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367488 00000100:00100000:0.0:1788330082.464319:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788330082.464333:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750367488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330082.464389:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:3.0:1788330082.464551:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4f100 x1875199750367488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330082.464585:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330082.464610:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750367488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330082.464653:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750367488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 323us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330082.464664:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:0.0:1788330083.038848:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330084.063097:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330084.679211:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330084.679329:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360768 00000100:00100000:3.0:1788330084.679344:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360768 00000100:00100000:3.0:1788330084.679434:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 281 00000100:00100000:3.0:1788330084.679446:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2349:x1875199729360768:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330084.679581:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b14450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2349:x1875199729360768:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 137us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330084.679590:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 281 00000100:00100000:0.0:1788330084.681313:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330084.681482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729360896 00000100:00100000:2.0:1788330084.681493:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729360896 00000100:00100000:2.0:1788330084.681665:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:2.0:1788330084.681679:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2349:x1875199729360896:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330084.681777:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2349:x1875199729360896:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 103us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330084.681785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00080000:1.0:1788330084.683271:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330084.703686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330084.703813:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361152 00000100:00100000:1.0:1788330084.703828:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361152 00000100:00100000:1.0:1788330084.703949:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:1.0:1788330084.703962:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729361152:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330084.704121:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2349:x1875199729361152:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 161us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330084.704131:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00080000:2.0:1788330084.704885:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330084.722514:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330084.722842:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361024 00000100:00100000:1.0:1788330084.722859:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361024 00000100:00100000:1.0:1788330084.722964:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:1.0:1788330084.722978:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2345:x1875199729361024:12345-192.168.202.47@tcp:9:kworker.0 00000100:00080000:2.0:1788330084.723213:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:1.0:1788330084.723270:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa986 00000100:00080000:1.0:1788330084.723282:0:6678:0:(import.c:65:import_set_state_nolock()) ffff95468a4d1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330084.723341:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788330084.723775:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+2:2345:x1875199729361024:12345-192.168.202.47@tcp:9:kworker.0 Request processed in 795us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330084.723786:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00010000:00010000:0.0:1788330084.725677:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330085.089335:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330085.537357:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750367744:0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.537462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330085.537564:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750368256:0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.537593:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330085.537627:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330085.537634:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750367872:0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.537656:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330085.537691:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367744 00000100:00100000:2.0:1788330085.537700:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367744 00000100:00100000:2.0:1788330085.537753:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367872 00000100:00100000:2.0:1788330085.537757:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367872 00000100:00100000:2.0:1788330085.537791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788330085.537801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750367744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.537880:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750367744:12345-0@lo:400:kworker.0 Request processed in 80us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330085.537888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788330085.537907:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788330085.537914:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750367872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.537943:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750367872:12345-0@lo:400:kworker.0 Request processed in 30us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330085.537949:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1788330085.537966:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330085.538008:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750367872:0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.538022:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750367744:0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.538674:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750367616:0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.538744:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330085.538793:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750368128:0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.538818:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330085.538842:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330085.538849:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750368000:0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.538871:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330085.538899:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750368384:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330085.538924:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330085.538954:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368256 00000100:00100000:3.0:1788330085.538961:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368256 00000100:00100000:3.0:1788330085.539012:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368000 00000100:00100000:3.0:1788330085.539015:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368000 00000100:00100000:3.0:1788330085.539036:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330085.539058:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750368256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.539103:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750368256:12345-0@lo:400:kworker.0 Request processed in 47us (1509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330085.539110:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330085.539126:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330085.539132:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750368000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.539178:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750368000:12345-0@lo:400:kworker.0 Request processed in 46us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330085.539185:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788330085.539211:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368128 00000100:00100000:3.0:1788330085.539214:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368128 00000100:00100000:3.0:1788330085.539244:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788330085.539251:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750368128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.539281:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750368128:12345-0@lo:400:kworker.0 Request processed in 31us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330085.539287:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:3.0:1788330085.539303:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330085.539308:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330085.539310:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788330085.539338:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfd9d180 x1875199750368000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330085.539351:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750368000:0@lo:400:kworker.0 00000100:00100000:3.0:1788330085.539361:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750368128:0@lo:400:kworker.0 00000100:00100000:2.0:1788330085.539827:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750368256:0@lo:400:kworker.0 00000100:00100000:0.0:1788330085.540446:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750367616 00000100:00100000:0.0:1788330085.540454:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750367616 00000100:00100000:0.0:1788330085.540507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788330085.540551:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750367616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330085.540640:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b15450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750367616:12345-0@lo:400:kworker.0 Request processed in 124us (1895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330085.540660:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1788330085.540832:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750367616:0@lo:400:kworker.0 00000100:00100000:1.0:1788330085.541054:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368384 00000100:00100000:1.0:1788330085.541060:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368384 00000100:00100000:1.0:1788330085.541105:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788330085.541114:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750368384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330085.541164:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330085.541232:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750368384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (2308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330085.541240:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788330085.541474:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750368384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788330086.111128:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330087.135242:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330087.583370:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750368512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330087.584221:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330087.584813:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368512 00000100:00100000:2.0:1788330087.584826:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368512 00000100:00100000:2.0:1788330087.584908:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788330087.584923:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750368512:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788330087.584946:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788330087.586572:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330087.586889:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750368512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1966us (3403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330087.586901:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788330087.587303:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469ba4dc00 x1875199750368512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330087.587356:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750368512:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788330088.159187:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330089.188774:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330089.216552:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:3.0:1788330089.216564:0:7629:0:(genops.c:885:class_export_put()) final put ffff95468a4d0800/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:0.0:1788330089.216699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95468a4d0800/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-OST0001 00000020:00000080:0.0:1788330089.216752:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95468a4d1000 for lustre-OST0001 00000100:00100000:1.0:1788330089.793496:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330089.793611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330089.793713:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361408 00000100:00100000:3.0:1788330089.793724:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361408 00000100:00100000:3.0:1788330089.793807:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:3.0:1788330089.793830:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729361408:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330089.794073:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729361408:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 245us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330089.794081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:1.0:1788330089.795274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330089.795356:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361536 00000100:00100000:3.0:1788330089.795365:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361536 00000100:00100000:3.0:1788330089.795429:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 120 00000100:00100000:3.0:1788330089.795438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729361536:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330089.795494:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729361536:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 57us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330089.795501:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 120 00000100:00080000:0.0:1788330089.796185:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330089.799038:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361280 00000100:00100000:2.0:1788330089.799054:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361280 00000100:00100000:2.0:1788330089.799215:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 283 00000100:00100000:2.0:1788330089.799228:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729361280:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330089.799363:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b16450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729361280:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 137us (5751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330089.799371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 283 00010000:00010000:2.0:1788330090.209906:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330090.658812:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750368640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330090.658888:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330090.658972:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368640 00000100:00100000:3.0:1788330090.658980:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368640 00000100:00100000:3.0:1788330090.659036:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788330090.659045:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750368640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330090.659083:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330090.659143:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750368640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330090.659160:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1788330090.659181:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330090.659218:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750368640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330090.661089:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750368896:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661162:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330090.661198:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788330090.661203:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750368768:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661234:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330090.661262:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750369280:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661284:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330090.661310:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750369024:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661333:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330090.661350:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330090.661355:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750369152:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661378:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330090.661408:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368896 00000100:00100000:3.0:1788330090.661415:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368896 00000100:00100000:3.0:1788330090.661457:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369280 00000100:00100000:3.0:1788330090.661460:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369280 00000100:00100000:3.0:1788330090.661480:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369024 00000100:00100000:3.0:1788330090.661483:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369024 00000100:00100000:3.0:1788330090.661499:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788330090.661506:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750368896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661588:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750368896:12345-0@lo:400:kworker.0 Request processed in 82us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330090.661596:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788330090.661622:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788330090.661629:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750369280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661660:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750369280:12345-0@lo:400:kworker.0 Request processed in 31us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330090.661665:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788330090.661676:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788330090.661682:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750369024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661712:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750369024:12345-0@lo:400:kworker.0 Request processed in 30us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330090.661718:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788330090.661735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750368768 00000100:00100000:3.0:1788330090.661739:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750368768 00000100:00100000:3.0:1788330090.661764:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788330090.661770:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750368768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661799:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750368768:12345-0@lo:400:kworker.0 Request processed in 29us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330090.661805:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1788330090.661837:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369152 00000100:00100000:3.0:1788330090.661840:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369152 00000100:00100000:3.0:1788330090.661868:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788330090.661875:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750369152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661905:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750369152:12345-0@lo:400:kworker.0 Request processed in 31us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330090.661911:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788330090.661931:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330090.661935:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330090.661958:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750368768:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661979:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750369280:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.661988:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750368896:0@lo:400:kworker.0 00010000:00080000:3.0:1788330090.662018:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469dbb1180 x1875199750369152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330090.662029:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750369152:0@lo:400:kworker.0 00000100:00100000:3.0:1788330090.662038:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750369024:0@lo:400:kworker.0 00010000:00010000:1.0:1788330091.230858:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330092.257547:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330092.386418:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330092.703499:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750369408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330092.703628:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330092.703733:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369408 00000100:00100000:3.0:1788330092.703743:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369408 00000100:00100000:3.0:1788330092.703818:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330092.703830:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750369408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330092.703882:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330092.703941:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750369408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330092.703949:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788330092.703974:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788330092.704011:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc22d80 x1875199750369408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330092.704035:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750369408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788330093.283404:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330094.305097:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788330094.827749:0:11839:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 02:21:33 (1788330093) 00000100:00100000:1.0:1788330094.939301:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330094.939367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330094.939401:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330094.939441:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361920 00000100:00100000:1.0:1788330094.939454:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361920 00000100:00100000:1.0:1788330094.939565:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361792 00000100:00100000:1.0:1788330094.939569:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361792 00000100:00100000:1.0:1788330094.939602:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 124 00000100:00100000:1.0:1788330094.939615:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729361920:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330094.939719:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729361920:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 106us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330094.939728:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 124 00000100:00100000:1.0:1788330094.939750:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 125 00000100:00100000:1.0:1788330094.939758:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729361792:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330094.939790:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2348:x1875199729361792:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330094.940912:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 125 00000100:00080000:1.0:1788330094.940965:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330094.941580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729361664 00000100:00100000:3.0:1788330094.941592:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729361664 00000100:00100000:3.0:1788330094.945710:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 285 00000100:00100000:3.0:1788330094.945740:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729361664:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330094.945890:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729361664:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 161us (6604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330094.945900:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 285 00010000:00010000:1.0:1788330095.328277:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330095.774980:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788330095.775025:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750369536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330095.775139:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330095.775560:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750370048:0@lo:400:kworker.0 00000100:00100000:0.0:1788330095.775613:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330095.775622:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750369792:0@lo:400:kworker.0 00000100:00100000:0.0:1788330095.775659:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788330095.775669:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750369664:0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.775670:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330095.775773:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750370048 00000100:00100000:1.0:1788330095.775784:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750370048 00000100:00100000:1.0:1788330095.775874:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788330095.775888:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750370048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330095.775971:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369536 00000100:00100000:3.0:1788330095.775978:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369536 00000100:00100000:3.0:1788330095.776027:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330095.776035:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750369536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330095.776086:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330095.780530:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330095.780561:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750369920:0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.780657:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330095.781268:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369792 00000100:00100000:2.0:1788330095.781283:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369792 00000100:00100000:2.0:1788330095.781374:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369920 00000100:00100000:2.0:1788330095.781378:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369920 00000100:00100000:2.0:1788330095.781412:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788330095.781424:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750369792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.781507:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750369792:12345-0@lo:400:kworker.0 Request processed in 85us (5838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330095.781540:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788330095.781564:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788330095.781572:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750369920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.781607:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750369920:12345-0@lo:400:kworker.0 Request processed in 36us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330095.781634:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788330095.781729:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750369920:0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.781754:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750369792:0@lo:400:kworker.0 00000100:00080000:2.0:1788330095.781968:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330095.781975:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330095.781978:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330095.782286:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330095.782366:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750370176:0@lo:400:kworker.0 00000100:00100000:0.0:1788330095.782415:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330095.782452:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750370176 00000100:00100000:0.0:1788330095.782458:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750370176 00000100:00100000:0.0:1788330095.782508:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788330095.782545:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750370176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330095.782564:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750370048:12345-0@lo:400:kworker.0 Request processed in 6676us (6948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330095.782577:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330095.782595:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750370176:12345-0@lo:400:kworker.0 Request processed in 77us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330095.782604:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788330095.782622:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750370176:0@lo:400:kworker.0 00000100:00080000:0.0:1788330095.782633:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788330095.782641:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546bfcfb800 x1875199750370048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788330111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330095.782654:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750370048:0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.782832:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750369664 00000100:00100000:2.0:1788330095.782838:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750369664 00000100:00100000:2.0:1788330095.782881:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1788330095.782888:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750369664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330095.782939:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750369664:12345-0@lo:400:kworker.0 Request processed in 52us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330095.782946:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788330095.783766:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750369664:0@lo:400:kworker.0 00000100:00100000:3.0:1788330095.785383:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750369536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9293us (10188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330095.785402:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788330095.785566:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750369536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788330096.351188:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330096.810704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330096.811587:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729362048 00000100:00100000:2.0:1788330096.811607:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729362048 00000100:00100000:2.0:1788330096.811823:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:2.0:1788330096.811841:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:10223:x1875199729362048:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330096.811872:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330096.811908:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aaa51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb5d expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.812021:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aaa58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.812078:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aaa58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.812097:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aaa58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330096.812158:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330096.812162:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330096.812222:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aaa58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.812255:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aaa51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb5d expref: 7 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.812279:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aaa58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb5d expref: 6 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.812289:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606f00) 00010000:00010000:2.0:1788330096.812293:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330096.812297:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ec00, rc 0) 00000100:00100000:2.0:1788330096.812394:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:10223:x1875199729362048:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 560us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330096.812402:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00080000:0.0:1788330096.815589:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330096.835683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330096.836371:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729362176 00000100:00100000:0.0:1788330096.836387:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729362176 00000100:00100000:0.0:1788330096.836589:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:0.0:1788330096.836602:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:10224:x1875199729362176:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330096.836654:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330096.836682:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaa5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb64 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.836792:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.836814:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.836830:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.836851:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.836858:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.836866:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837218:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9aaa74 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837228:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9aaa74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837236:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9aaa74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330096.837275:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788330096.837286:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330096.837317:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9aaa74 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837332:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837340:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837348:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837355:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330096.837360:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837369:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837386:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606f00) 00010000:00010000:0.0:1788330096.837390:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330096.837396:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837403:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaa66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837416:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837423:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837441:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837447:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330096.837450:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837457:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837465:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9546a5cd6000) 00010000:00010000:0.0:1788330096.837468:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330096.837472:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837477:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaa6d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837586:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaa5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb64 expref: 8 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837604:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9aaa74 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb64 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330096.837613:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9546a5cd6200) 00010000:00010000:0.0:1788330096.837615:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330096.837618:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf600, rc 0) 00000100:00100000:0.0:1788330096.837712:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:10224:x1875199729362176:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1112us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330096.837731:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:3.0:1788330096.848415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330096.848717:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729362432 00000100:00100000:2.0:1788330096.849077:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729362432 00000100:00100000:2.0:1788330096.849169:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:2.0:1788330096.849181:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:10224:x1875199729362432:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330096.849208:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330096.849259:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aaa7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb6b expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.849356:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.849373:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.849388:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.849409:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.849418:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.849425:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.850619:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cce00/0x91094de4de9aaa90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851128:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cce00/0x91094de4de9aaa90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851140:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cce00/0x91094de4de9aaa90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330096.851157:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788330096.851390:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851415:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851424:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851431:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330096.851437:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851446:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851463:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9546a5cd6200) 00010000:00010000:2.0:1788330096.851467:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330096.851473:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851479:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9aaa82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851498:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851504:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851511:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851587:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330096.851597:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851603:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851612:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff954692606600) 00010000:00010000:2.0:1788330096.851615:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330096.851618:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.851625:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9aaa89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.852374:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aaa7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb6b expref: 10 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.852399:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cce00/0x91094de4de9aaa90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb6b expref: 9 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330096.852409:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:2.0:1788330096.852412:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330096.852415:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cce00, rc 0) 00000100:00100000:2.0:1788330096.852602:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10224:x1875199729362432:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 3419us (4202us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788330096.852616:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:1.0:1788330096.863742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330096.864140:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729362560 00000100:00100000:2.0:1788330096.864156:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729362560 00000100:00100000:2.0:1788330096.864286:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:2.0:1788330096.864300:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10224:x1875199729362560:12345-192.168.202.47@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788330096.864617:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10224:x1875199729362560:12345-192.168.202.47@tcp:59:lhsmtool_posix.0 Request processed in 317us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330096.864626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 35 00010000:00010000:1.0:1788330097.375099:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330097.503624:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788330097.824371:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750370304:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330097.824487:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330097.826727:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750370304 00000100:00100000:3.0:1788330097.826747:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750370304 00000100:00100000:3.0:1788330097.826853:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788330097.826866:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750370304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330097.826921:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330097.827043:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750370304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (2555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330097.827052:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788330097.828313:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469bc21500 x1875199750370304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330097.828345:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750370304:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788330097.829855:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330098.401009:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330099.010360:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330099.015412:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729362688 00000100:00100000:3.0:1788330099.015490:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729362688 00000100:00100000:3.0:1788330099.016199:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:3.0:1788330099.016211:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10266:x1875199729362688:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330099.016244:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330099.016266:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaa9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016333:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016348:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016360:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016375:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016382:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016390:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016631:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016640:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016646:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016652:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330099.016664:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016672:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016685:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606f00) 00010000:00010000:3.0:1788330099.016688:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330099.016692:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016699:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaa5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016718:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016725:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016731:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016736:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330099.016739:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016745:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016753:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff95468a2cce00) 00010000:00010000:3.0:1788330099.016755:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330099.016765:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016771:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaaac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016807:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaa9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb72 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016817:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606f00) 00010000:00010000:3.0:1788330099.016820:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330099.016824:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaa9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb72 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.016833:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9000, rc 0) 00000100:00100000:3.0:1788330099.017154:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10266:x1875199729362688:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 944us (6802us total) trans 0 rc 301/301 00000100:00100000:3.0:1788330099.017163:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00080000:0.0:1788330099.021678:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330099.022344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.023011:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729362944 00000100:00100000:0.0:1788330099.023032:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729362944 00000100:00100000:0.0:1788330099.023119:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:0.0:1788330099.023132:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10266:x1875199729362944:12345-192.168.202.47@tcp:36:lfs.0 00010000:00010000:0.0:1788330099.023193:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330099.023232:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aaa58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb5d expref: 9 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.023254:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606f00) 00010000:00010000:0.0:1788330099.023267:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330099.023496:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.023511:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.023544:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.023558:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.023565:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.023572:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330099.024477:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788330099.024490:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.024499:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.024505:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.024512:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.024543:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.024552:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.024566:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330099.024569:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.024574:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.024579:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaab3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330099.024596:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003900f661 reply state 00000000ba06e3f8 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330099.024607:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330099.024741:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+10:10266:x1875199729362944:12345-192.168.202.47@tcp:36:lfs.0 Request processed in 1609us (2401us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788330099.024757:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 37 00010000:00010000:0.0:1788330099.030677:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.030697:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.030705:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.030711:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacec00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.030716:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.030724:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.030743:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9546a5cd6500) 00010000:00010000:0.0:1788330099.030746:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.030751:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.030757:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaaba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330099.105951:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330099.105991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363072 00000100:00100000:3.0:1788330099.106003:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363072 00000100:00100000:3.0:1788330099.106077:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00100000:3.0:1788330099.106089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10274:x1875199729363072:12345-192.168.202.47@tcp:101:lctl.0 00010000:00010000:3.0:1788330099.106115:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330099.106138:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaac1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb79 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.106213:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaac8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.106235:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.106250:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330099.106291:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788330099.106295:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330099.106337:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaac8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.106363:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaac1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb79 expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.106380:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaac8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb79 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.106388:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:3.0:1788330099.106391:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330099.106395:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9200, rc 0) 00000100:00100000:3.0:1788330099.106448:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+10:10274:x1875199729363072:12345-192.168.202.47@tcp:101:lctl.0 Request processed in 361us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330099.106456:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00100000:3.0:1788330099.160473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.160607:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363200 00000100:00100000:0.0:1788330099.160622:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363200 00000100:00100000:0.0:1788330099.160691:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:0.0:1788330099.160701:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+10:10280:x1875199729363200:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330099.160721:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330099.160754:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaacf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb80 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161037:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161054:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161067:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161084:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161092:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161099:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161198:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9aaae4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161207:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9aaae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161215:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9aaae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330099.161241:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788330099.161244:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330099.161283:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9aaae4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161304:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161310:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161317:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161323:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.161328:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.161335:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.165945:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:0.0:1788330099.165955:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.165963:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.165974:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaad6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.165994:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166001:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166008:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166041:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.166046:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166053:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166064:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9546a5cd6500) 00010000:00010000:0.0:1788330099.166067:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.166070:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166075:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9aaadd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166137:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aaacf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb80 expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166151:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9aaae4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb80 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.166158:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330099.166160:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788330099.166162:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacea00, rc 0) 00000100:00100000:0.0:1788330099.166255:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+11:10280:x1875199729363200:12345-192.168.202.47@tcp:101:bash.0 Request processed in 5555us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330099.166266:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:1.0:1788330099.169685:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330099.169744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363456 00000100:00100000:3.0:1788330099.169754:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363456 00000100:00100000:3.0:1788330099.169801:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330099.169810:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+11:10280:x1875199729363456:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330099.169848:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330099.169866:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaaeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb87 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.169974:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.169988:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.169998:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.171282:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.171298:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.171308:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330099.171860:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788330099.172026:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172037:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172046:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172099:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172107:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172114:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172119:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330099.172124:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172131:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172144:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330099.172147:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330099.172151:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172157:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aaaf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330099.172170:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000463f96bd reply state 000000008f034ef4 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330099.172185:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788330099.172225:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aaaeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172253:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.172261:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:3.0:1788330099.172263:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330099.172270:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8e00, rc 0) 00000100:00100000:3.0:1788330099.172378:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10280:x1875199729363456:12345-192.168.202.47@tcp:101:bash.0 Request processed in 2567us (2701us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788330099.172387:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330099.176369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330099.176462:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363584 00000100:00100000:1.0:1788330099.176472:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363584 00000100:00100000:1.0:1788330099.176540:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:1.0:1788330099.176550:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875199729363584:12345-192.168.202.47@tcp:8:bash.0 00010000:00080000:1.0:1788330099.176583:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 354 last 0 00000020:00000080:1.0:1788330099.176613:0:6677:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9aab0e 00002000:00100000:1.0:1788330099.176648:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a815e47-382d-4064-91e8-23b9de97ce7e/ffff9546a1ee2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330099.176673:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330099.176904:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788330099.176933:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330099.177007:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729363584:12345-192.168.202.47@tcp:8:bash.0 Request processed in 457us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330099.177028:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 20 00010000:00010000:2.0:1788330099.177258:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.177270:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.177279:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.177285:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330099.177290:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.177298:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.177316:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95468a2cc200) 00010000:00010000:2.0:1788330099.177319:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330099.177325:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.177356:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaaf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330099.179786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.179846:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363712 00000100:00100000:2.0:1788330099.179857:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363712 00000100:00080000:3.0:1788330099.179916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330099.179940:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:2.0:1788330099.179952:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:0:x1875199729363712:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330099.179969:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330099.179991:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb8e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330099.180046:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788330099.180065:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1788330099.180070:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330099.180079:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.180098:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 7 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.180111:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc600, rc 0) 00000100:00100000:2.0:1788330099.180165:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:0:x1875199729363712:12345-192.168.202.47@tcp:101:bash.0 Request processed in 215us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330099.180172:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:1.0:1788330099.182369:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330099.182425:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363840 00000100:00100000:3.0:1788330099.182434:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363840 00000100:00100000:3.0:1788330099.182494:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:3.0:1788330099.182505:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:10280:x1875199729363840:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330099.182566:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330099.182586:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb95 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.182614:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.182623:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330099.182628:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330099.182634:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.182683:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.182696:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330099.182711:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875199750370432:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330099.182808:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330099.184710:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875199750370432:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330099.184739:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.184756:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9000, rc 0) 00000100:00100000:1.0:1788330099.184809:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:10280:x1875199729363840:12345-192.168.202.47@tcp:101:bash.0 Request processed in 2307us (2449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330099.184817:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330099.184830:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:0.0:1788330099.184918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729363968 00000100:00100000:0.0:1788330099.184935:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729363968 00010000:00010000:0.0:1788330099.184959:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330099.184984:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:0.0:1788330099.184990:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729363968:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330099.185000:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330099.185027:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.185040:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.185070:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000022e119f3/0x91094de4de9aab15 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb8e expref: 8 pid: 6678 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.185085:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330099.185090:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330099.185098:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.185112:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.185147:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330099.185172:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875199750370560:192.168.202.47@tcp:105: 00000100:00100000:0.0:1788330099.185390:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330099.191458:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875199750370560:192.168.202.47@tcp:105: 00010000:00010000:0.0:1788330099.191487:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330099.191580:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729363968:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 6587us (6767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330099.191591:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:3.0:1788330099.195915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.195986:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729364224 00000100:00100000:2.0:1788330099.195996:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729364224 00000100:00100000:2.0:1788330099.196132:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:2.0:1788330099.196144:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+13:10280:x1875199729364224:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:2.0:1788330099.196510:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10280:x1875199729364224:12345-192.168.202.47@tcp:35:bash.0 Request processed in 367us (603us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788330099.196558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:2.0:1788330099.259325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.259495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729364480 00000100:00100000:0.0:1788330099.259507:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729364480 00000100:00100000:0.0:1788330099.259618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:0.0:1788330099.259831:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10290:x1875199729364480:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330099.259859:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330099.259882:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aab23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eb9c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330099.259974:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788330099.260105:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aab23 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb9c expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.260119:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:0.0:1788330099.260122:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330099.260126:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9aab23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb9c expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.260139:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacec00, rc 0) 00000100:00100000:0.0:1788330099.260299:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10290:x1875199729364480:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 670us (986us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788330099.260307:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:3.0:1788330099.264188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.264270:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729364736 00000100:00100000:0.0:1788330099.264281:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729364736 00000100:00100000:0.0:1788330099.264354:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:0.0:1788330099.264373:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10290:x1875199729364736:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330099.264700:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+16:10290:x1875199729364736:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 337us (522us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788330099.264707:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330099.342374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.342761:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729364864 00000100:00100000:2.0:1788330099.342772:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729364864 00000100:00100000:2.0:1788330099.342848:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:2.0:1788330099.342858:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+16:10296:x1875199729364864:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330099.342882:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330099.342904:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aab31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eba3 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.342972:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aab38 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.342985:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aab38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.342998:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aab38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330099.343795:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788330099.343800:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330099.343823:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aab38 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.343855:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aab31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eba3 expref: 18 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.343889:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aab38 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eba3 expref: 17 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.343895:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330099.343897:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330099.343900:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cdc00, rc 0) 00000100:00100000:2.0:1788330099.343962:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+17:10296:x1875199729364864:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1106us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330099.343967:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:1.0:1788330099.348913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.349008:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729365120 00000100:00100000:2.0:1788330099.349029:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729365120 00000100:00100000:2.0:1788330099.349130:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:2.0:1788330099.349141:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+17:10296:x1875199729365120:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330099.349166:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330099.349189:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebaa expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.349302:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aab46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.349316:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aab46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.349328:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aab46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330099.349341:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788330099.349477:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebaa expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.349491:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aab46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebaa expref: 19 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.349497:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:2.0:1788330099.349499:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330099.349502:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc600, rc 0) 00000100:00100000:2.0:1788330099.349572:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10296:x1875199729365120:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 434us (671us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788330099.349577:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:1.0:1788330099.352630:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.352680:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729365376 00000100:00100000:2.0:1788330099.352691:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729365376 00000100:00100000:2.0:1788330099.352791:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:2.0:1788330099.352802:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10296:x1875199729365376:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330099.352837:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330099.352856:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebb1 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.352953:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.352967:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.352979:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330099.353007:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788330099.353144:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb1 expref: 22 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.353163:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb1 expref: 21 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.353172:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:2.0:1788330099.353174:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330099.353177:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cde00, rc 0) 00000100:00100000:2.0:1788330099.353242:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10296:x1875199729365376:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 442us (619us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788330099.353249:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:3.0:1788330099.355717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330099.355862:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729365504 00000100:00100000:1.0:1788330099.355874:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729365504 00000100:00100000:1.0:1788330099.355941:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330099.355951:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+21:2348:x1875199729365504:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330099.355966:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330099.355992:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aab46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebaa expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.356039:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:1.0:1788330099.356044:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330099.356106:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:2348:x1875199729365504:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 156us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330099.356114:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330099.363851:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.364513:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729365632 00000100:00100000:2.0:1788330099.364547:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729365632 00000100:00100000:2.0:1788330099.364613:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:2.0:1788330099.364627:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729365632:12345-192.168.202.47@tcp:1:lfs.0 00010000:00010000:2.0:1788330099.364676:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.364699:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.364715:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330099.364720:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330099.364725:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.364775:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.364790:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 7 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330099.364805:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875199750370688:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330099.364914:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330099.369601:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.369661:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6678:1875199750370688:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330099.369690:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330099.369896:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729365760 00000100:00100000:3.0:1788330099.369905:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729365760 00002000:00100000:3.0:1788330099.369951:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9546bf4f4000 x1875199729365760/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:115/0 lens 504/0 e 0 to 0 dl 1788330110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330099.369961:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bf4f4000 with x1875199729365760 ext(0->12) 00010000:00010000:3.0:1788330099.369969:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 8 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330099.369982:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 8 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330099.369990:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9546bf4f4000 00000100:00100000:3.0:1788330099.370045:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:3.0:1788330099.370057:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729365760:12345-192.168.202.47@tcp:4:lfs.0 00000001:00100000:3.0:1788330099.413878:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000100:00100000:1.0:1788330099.414508:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729365760:12345-192.168.202.47@tcp:4:lfs.0 Request processed in 44446us (44909us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788330099.414539:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00002000:00100000:1.0:1788330099.414552:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9546bf4f4000 x1875199729365760/t4294967299(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:115/0 lens 504/448 e 0 to 0 dl 1788330110 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330099.414561:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bf4f4000 with x1875199729365760 ext(0->12) 00010000:00010000:1.0:1788330099.414572:0:6682:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 9 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.414591:0:6682:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 9 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330099.414600:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9546bf4f4000 00000001:00080000:3.0:1788330099.417765:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967314 is committed 00000001:00080000:3.0:1788330099.417786:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:0.0:1788330099.417927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330099.418039:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729365888 00000100:00100000:1.0:1788330099.418049:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729365888 00010000:00010000:1.0:1788330099.418089:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 9 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330099.418160:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:1.0:1788330099.418186:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2348:x1875199729365888:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330099.418201:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788330099.418221:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788330099.418224:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788330099 00002000:00010000:1.0:1788330099.418226:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788330099 00002000:00010000:1.0:1788330099.418228:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788330099 00010000:00010000:1.0:1788330099.418235:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 9 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.418248:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 9 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.418277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049674b19/0x91094de4de9aab1c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb95 expref: 9 pid: 6677 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.418296:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330099.418301:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330099.418308:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.418332:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.418363:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330099.418420:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2348:x1875199729365888:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 235us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330099.418428:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 36 00010000:00010000:2.0:1788330099.418490:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418499:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418541:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418550:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418570:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418577:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330099.418582:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418591:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418604:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.418611:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4a812a7/0x91094de4de9aab69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330099.418733:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729365632:12345-192.168.202.47@tcp:1:lfs.0 Request processed in 54109us (54893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330099.418742:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:0.0:1788330099.421366:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.421457:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729366144 00000100:00100000:2.0:1788330099.421467:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729366144 00000100:00100000:2.0:1788330099.421556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:2.0:1788330099.421568:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+12:10296:x1875199729366144:12345-192.168.202.47@tcp:35:lfs.0 00000004:00010000:2.0:1788330099.421652:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb1 expref: 12 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330099.422092:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788330099.422151:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788330099.422768:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788330099.422825:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.422842:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.422851:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.422888:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.422905:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 16 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330099.422919:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875199750370816:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330099.423005:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330099.425706:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875199750370816:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330099.425753:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.426022:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330099.430357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330099.431365:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729366272 00000100:00100000:1.0:1788330099.431378:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729366272 00010000:00010000:1.0:1788330099.431426:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330099.431507:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:1.0:1788330099.431543:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+17:2347:x1875199729366272:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330099.431561:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330099.431569:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.431585:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.431620:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aab00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb87 expref: 17 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.431641:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:1.0:1788330099.431647:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.431656:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.431663:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.431688:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330099.431764:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+16:2347:x1875199729366272:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 246us (1417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330099.431772:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 37 00010000:00010000:2.0:1788330099.432161:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.432169:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330099.432298:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788330099.432542:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1788330099.432670:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750370944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788330099.432869:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330099.432902:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369600 going to sleep for 11 seconds 00000100:00100000:0.0:1788330099.433470:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750370944 00000100:00100000:0.0:1788330099.433479:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750370944 00000100:00100000:0.0:1788330099.433583:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330099.433593:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875199750370944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788330099.433689:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875199750370944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 99us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330099.433696:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788330099.434215:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330099.434253:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f5180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750370944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788330099.435057:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788330099.435130:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf299500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750371072:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788330099.435178:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330099.435206:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369180 going to sleep for 11 seconds 00000100:00100000:2.0:1788330099.435237:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750371072 00000100:00100000:2.0:1788330099.435242:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750371072 00000100:00100000:2.0:1788330099.435268:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330099.435273:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875199750371072:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788330099.435409:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875199750371072:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 135us (231us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788330099.435416:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330099.435445:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf299500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750371072:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788330099.435484:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788330099.435533:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.435543:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.435561:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.435567:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330099.435572:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.435579:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.435595:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:2.0:1788330099.435598:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788330099.436132:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.436142:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330099.436328:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788330099.437854:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788330099.437875:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 354350356765ns, next at 355350352513ns, rc = 0 00000001:00080000:2.0:1788330099.437890:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788330099.437948:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff95468a2ccc00) 00010000:00010000:2.0:1788330099.437952:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330099.437963:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb1 expref: 20 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330099.438103:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10296:x1875199729366144:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 16535us (16747us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788330099.438126:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00000020:00080000:2.0:1788330099.438132:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788330099.440881:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.441081:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729366400 00000100:00100000:0.0:1788330099.441092:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729366400 00000100:00100000:0.0:1788330099.441182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:0.0:1788330099.441193:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10296:x1875199729366400:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330099.441219:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330099.441241:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aab77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebb8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.441314:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aab77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb8 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.441328:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aab77 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb8 expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.441347:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330099.441350:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330099.441354:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface400, rc 0) 00000100:00100000:0.0:1788330099.441446:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+20:10296:x1875199729366400:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 255us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330099.441453:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:3.0:1788330099.444454:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.444562:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729366656 00000100:00100000:2.0:1788330099.444572:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729366656 00000100:00100000:2.0:1788330099.444650:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:2.0:1788330099.444661:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:10296:x1875199729366656:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:2.0:1788330099.444923:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d57450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10296:x1875199729366656:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 263us (478us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788330099.444930:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:3.0:1788330099.534002:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.534156:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729366912 00000100:00100000:0.0:1788330099.534167:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729366912 00000100:00100000:0.0:1788330099.534234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:0.0:1788330099.534244:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10306:x1875199729366912:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330099.534271:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330099.534292:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9aab7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebbf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330099.534409:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788330099.534583:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9aab7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebbf expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.534599:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:0.0:1788330099.534602:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330099.534633:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9aab7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebbf expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.534647:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfc00, rc 0) 00000100:00100000:0.0:1788330099.535288:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10306:x1875199729366912:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 466us (717us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788330099.535297:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:1.0:1788330099.539578:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.539732:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729367040 00000100:00100000:2.0:1788330099.539742:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729367040 00000100:00100000:2.0:1788330099.539799:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 47 00000100:00100000:2.0:1788330099.539809:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10306:x1875199729367040:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:2.0:1788330099.539901:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.539916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.539928:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.539942:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.539948:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.539953:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540219:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540229:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540236:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330099.540284:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540297:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540303:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540310:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540329:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cde00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330099.540332:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540339:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540352:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330099.540355:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330099.540360:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540373:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aab8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540389:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540394:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540400:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540405:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330099.540408:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540415:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540423:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954692606600) 00010000:00010000:2.0:1788330099.540425:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330099.540428:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540434:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aab93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540448:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540454:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540464:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540470:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330099.540473:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540479:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540486:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:2.0:1788330099.540488:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330099.540491:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.540497:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aab9a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330099.540596:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10306:x1875199729367040:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 785us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330099.540615:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 47 00000100:00100000:3.0:1788330099.544063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.545312:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729367296 00000100:00100000:2.0:1788330099.545338:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729367296 00000100:00100000:2.0:1788330099.545414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:2.0:1788330099.545425:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10306:x1875199729367296:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:2.0:1788330099.545729:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:10306:x1875199729367296:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 304us (1728us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788330099.545737:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:1.0:1788330099.587993:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.588207:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729367552 00000100:00100000:0.0:1788330099.588219:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729367552 00000100:00100000:0.0:1788330099.588283:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:0.0:1788330099.588294:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:10309:x1875199729367552:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330099.588438:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330099.588462:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebc6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.588573:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.588588:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.588599:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.588716:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.588725:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.588732:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589074:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589083:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589089:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330099.589099:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788330099.589187:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589194:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589200:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589205:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.589210:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589217:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589229:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330099.589232:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.589236:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589252:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaba8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589265:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589271:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589277:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589282:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.589285:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589291:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589299:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6500) 00010000:00010000:0.0:1788330099.589302:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.589304:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.589310:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.590049:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.590067:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.590084:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330099.590086:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330099.590089:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface200, rc 0) 00000100:00100000:0.0:1788330099.590172:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+25:10309:x1875199729367552:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1877us (2186us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788330099.590181:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:0.0:1788330099.594492:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.594793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729367680 00000100:00100000:2.0:1788330099.594803:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729367680 00000100:00100000:2.0:1788330099.594960:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:2.0:1788330099.594971:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+25:10309:x1875199729367680:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:2.0:1788330099.595060:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595077:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595090:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595117:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595124:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595131:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595137:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330099.595143:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595150:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595163:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:2.0:1788330099.595166:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330099.595171:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.595195:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330099.595286:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+25:10309:x1875199729367680:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 316us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330099.595294:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:1.0:1788330099.597592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330099.597737:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729367936 00000100:00100000:3.0:1788330099.597747:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729367936 00000100:00100000:3.0:1788330099.597807:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:3.0:1788330099.597971:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+25:10309:x1875199729367936:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330099.598226:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+26:10309:x1875199729367936:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 409us (646us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788330099.598234:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:1.0:1788330099.894036:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.894161:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729368192 00000100:00100000:2.0:1788330099.894172:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729368192 00000100:00100000:2.0:1788330099.894275:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:2.0:1788330099.894287:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+26:10340:x1875199729368192:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:2.0:1788330099.894313:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330099.894345:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebcd expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.894456:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aabd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.894470:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aabd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.894482:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aabd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330099.894492:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788330099.894788:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aabcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebcd expref: 29 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.894807:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aabd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebcd expref: 28 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330099.894833:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:2.0:1788330099.894836:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330099.894840:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd200, rc 0) 00000100:00100000:2.0:1788330099.894910:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+28:10340:x1875199729368192:12345-192.168.202.47@tcp:101:cat.0 Request processed in 625us (888us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788330099.894916:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:0.0:1788330099.900784:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330099.901070:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729368448 00000100:00100000:2.0:1788330099.901081:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729368448 00000100:00100000:2.0:1788330099.901143:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:2.0:1788330099.901154:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+28:10340:x1875199729368448:12345-192.168.202.47@tcp:35:cat.0 00000100:00100000:2.0:1788330099.901441:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:10340:x1875199729368448:12345-192.168.202.47@tcp:35:cat.0 Request processed in 286us (665us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788330099.901448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:1.0:1788330099.906288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.906392:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729368576 00000100:00100000:0.0:1788330099.906405:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729368576 00000100:00100000:0.0:1788330099.906506:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:0.0:1788330099.906555:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:2348:x1875199729368576:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330099.906576:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330099.906606:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aabd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebcd expref: 29 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.906624:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330099.906629:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330099.906687:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a372c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+28:2348:x1875199729368576:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 172us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330099.906694:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:1.0:1788330099.948678:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.948875:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729368832 00000100:00100000:0.0:1788330099.948884:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729368832 00000100:00100000:0.0:1788330099.948980:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:0.0:1788330099.948991:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+28:10346:x1875199729368832:12345-192.168.202.47@tcp:101:dd.0 00010000:00010000:0.0:1788330099.949054:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330099.949057:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788330099.949084:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aab38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eba3 expref: 28 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.949114:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330099.949119:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330099.949133:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aabe0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebd4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.949218:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.949228:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.949234:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.949257:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.949267:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 28 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330099.949276:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750371200:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330099.949372:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330099.952732:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330099.953441:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729368960 00000100:00100000:1.0:1788330099.953451:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729368960 00010000:00010000:1.0:1788330099.953490:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330099.953552:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00100000:1.0:1788330099.953561:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+29:2347:x1875199729368960:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330099.953573:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330099.953578:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.953589:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.953615:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:1.0:1788330099.953619:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.953626:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.953644:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330099.953659:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330099.953715:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+29:2347:x1875199729368960:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 153us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330099.953722:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 38 00010000:00010000:0.0:1788330099.954257:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aabb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebc6 expref: 28 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330099.954285:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750371200:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330099.954309:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.954325:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.954331:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330099.954349:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788330099.954537:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aabe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.954554:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.954561:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330099.954564:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330099.954566:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330099.954712:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+28:10346:x1875199729368832:12345-192.168.202.47@tcp:101:dd.0 Request processed in 5714us (6034us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788330099.954719:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:3.0:1788330099.956162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330099.956203:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729369216 00000100:00100000:0.0:1788330099.956212:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729369216 00000100:00100000:0.0:1788330099.956263:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:0.0:1788330099.956272:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+28:10346:x1875199729369216:12345-192.168.202.47@tcp:36:dd.0 00010000:00010000:0.0:1788330099.956511:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.956545:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.956553:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330099.956592:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788330099.956614:0:5844:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a8a57f5d reply state 00000000abe9e692 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330099.956622:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330099.956877:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+31:10346:x1875199729369216:12345-192.168.202.47@tcp:36:dd.0 Request processed in 604us (717us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788330099.956884:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 52 00000020:00080000:0.0:1788330099.956889:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788330099.958300:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.958359:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.958369:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.958375:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330099.958380:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.958388:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.958485:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330099.958489:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330099.958493:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330099.958500:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aabf5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330100.036100:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.036156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.036215:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330100.036334:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729369344 00000100:00100000:2.0:1788330100.036344:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729369344 00000100:00100000:2.0:1788330100.036403:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 287 00000100:00100000:2.0:1788330100.036413:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729369344:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330100.036484:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729369344:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 72us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330100.036491:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 287 00000100:00100000:0.0:1788330100.037025:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729369600 00000100:00100000:0.0:1788330100.037032:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729369600 00000100:00100000:0.0:1788330100.037085:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 129 00000100:00100000:0.0:1788330100.037094:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729369600:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330100.037136:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729369600:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 44us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330100.037144:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 129 00000100:00080000:0.0:1788330100.037165:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330100.037317:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729369472 00000100:00100000:1.0:1788330100.037322:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729369472 00000100:00100000:1.0:1788330100.037360:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:1.0:1788330100.037366:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729369472:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330100.037396:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729369472:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 30us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330100.037402:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:1.0:1788330100.088110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330100.089202:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729369728 00000100:00100000:2.0:1788330100.089216:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729369728 00000100:00100000:2.0:1788330100.089288:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:2.0:1788330100.089314:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+30:10361:x1875199729369728:12345-192.168.202.47@tcp:101:stat.0 00010000:00010000:2.0:1788330100.089355:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330100.089377:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aabfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebdb expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089448:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089463:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089477:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089492:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089498:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089505:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089977:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089989:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.089998:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.090046:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.090068:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 31 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330100.090082:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf299180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750371328:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330100.090253:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330100.092378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.092473:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729369984 00000100:00100000:1.0:1788330100.092483:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729369984 00000100:00100000:1.0:1788330100.092584:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:1.0:1788330100.092595:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+32:5588:x1875199729369984:12345-192.168.202.47@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788330100.093244:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+33:5588:x1875199729369984:12345-192.168.202.47@tcp:35:ldlm_bl.0 Request processed in 648us (873us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788330100.093253:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788330100.094292:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf299180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750371328:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330100.094320:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330100.095065:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.095176:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729370112 00000100:00100000:0.0:1788330100.095183:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729370112 00010000:00010000:0.0:1788330100.095219:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 33 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330100.095261:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:0.0:1788330100.095271:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+33:2346:x1875199729370112:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330100.095287:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330100.095294:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 33 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.095319:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 33 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.095343:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aabe7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebd4 expref: 33 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.095360:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330100.095365:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.095375:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.095382:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.095412:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330100.095471:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+32:2346:x1875199729370112:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 202us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330100.095479:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 39 00010000:00010000:3.0:1788330100.095552:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.095561:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330100.095609:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788330100.095613:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330100.096026:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096041:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096051:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096057:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096064:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096070:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.096074:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096081:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096091:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330100.096095:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.096099:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096113:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aac03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096127:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096133:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096139:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096145:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.096148:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096154:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096162:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954692606600) 00010000:00010000:3.0:1788330100.096164:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.096167:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096172:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aac0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096223:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aabfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebdb expref: 32 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096249:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebdb expref: 31 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.096255:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:3.0:1788330100.096257:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330100.096259:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc600, rc 0) 00000100:00100000:3.0:1788330100.096290:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+31:10361:x1875199729369728:12345-192.168.202.47@tcp:101:stat.0 Request processed in 6978us (8198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.096298:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:2.0:1788330100.187663:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.190129:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729370368 00000100:00100000:0.0:1788330100.190147:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729370368 00000100:00100000:0.0:1788330100.190228:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:0.0:1788330100.190240:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+31:10367:x1875199729370368:12345-192.168.202.47@tcp:36:truncate.0 00010000:00010000:0.0:1788330100.190296:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330100.190332:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aac11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebdb expref: 31 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.190374:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330100.190379:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330100.190960:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.190976:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.190985:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330100.191055:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788330100.191079:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d50ff49e reply state 00000000025b1fef transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330100.191087:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330100.191237:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+33:10367:x1875199729370368:12345-192.168.202.47@tcp:36:truncate.0 Request processed in 998us (3580us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788330100.191245:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 54 00000020:00080000:0.0:1788330100.191250:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788330100.196830:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.196848:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.196857:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.196861:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.196865:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.196871:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.196885:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:3.0:1788330100.196887:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.196890:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.196906:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aac18 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330100.293436:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.293615:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729370496 00000100:00100000:0.0:1788330100.293688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729370496 00000100:00100000:0.0:1788330100.293862:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:0.0:1788330100.293874:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:10381:x1875199729370496:12345-192.168.202.47@tcp:101:stat.0 00010000:00010000:0.0:1788330100.293899:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330100.293922:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aac1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebe2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294046:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294060:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294072:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294086:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294106:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294113:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294352:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294361:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294369:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330100.294411:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788330100.294417:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330100.294448:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294472:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294480:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294486:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294493:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294499:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330100.294504:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294512:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294551:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330100.294555:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330100.294560:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294567:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294578:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294585:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294596:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294601:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330100.294604:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294611:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294619:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6500) 00010000:00010000:0.0:1788330100.294622:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330100.294625:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294644:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294677:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aac1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294689:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.294696:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330100.294698:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330100.294701:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf800, rc 0) 00000100:00100000:0.0:1788330100.295248:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+33:10381:x1875199729370496:12345-192.168.202.47@tcp:101:stat.0 Request processed in 1373us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330100.295266:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:2.0:1788330100.355607:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.355722:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729370752 00000100:00100000:0.0:1788330100.355733:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729370752 00000100:00100000:0.0:1788330100.355791:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 56 00000100:00100000:0.0:1788330100.355803:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+33:10391:x1875199729370752:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330100.355825:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330100.355845:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aac3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebe9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330100.355941:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788330100.356109:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aac3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe9 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.356124:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:0.0:1788330100.356127:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330100.356132:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aac3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe9 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.356146:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface800, rc 0) 00000100:00100000:0.0:1788330100.356208:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+34:10391:x1875199729370752:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 407us (612us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788330100.356215:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 56 00000100:00100000:1.0:1788330100.363196:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.366922:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729371008 00000100:00100000:0.0:1788330100.366940:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729371008 00000100:00100000:0.0:1788330100.367028:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:0.0:1788330100.367040:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+34:10391:x1875199729371008:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330100.367325:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+35:10391:x1875199729371008:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 287us (4140us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788330100.367333:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00010000:00010000:0.0:1788330100.446721:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330100.452217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.452370:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729371264 00000100:00100000:3.0:1788330100.452381:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729371264 00000100:00100000:3.0:1788330100.452510:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:3.0:1788330100.452556:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+35:10397:x1875199729371264:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330100.452591:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330100.452617:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aac49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebf0 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.452729:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.452744:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.452753:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.452794:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.452809:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 36 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330100.452823:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750371456:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330100.452923:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5bc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330100.454886:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750371456:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330100.454917:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330100.456081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.456301:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729371392 00000100:00100000:1.0:1788330100.456312:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729371392 00010000:00010000:1.0:1788330100.456357:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330100.456447:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:1.0:1788330100.456456:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+37:2346:x1875199729371392:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330100.456475:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330100.456489:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.456502:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.456551:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aac34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebe2 expref: 37 pid: 5844 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.456571:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:1.0:1788330100.456588:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.456597:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.456611:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.456640:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330100.456706:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+36:2346:x1875199729371392:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 250us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330100.456714:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 40 00010000:00010000:2.0:1788330100.456768:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.456776:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330100.456797:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788330100.456944:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aac49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 37 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.456965:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 36 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.456973:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:2.0:1788330100.456976:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330100.456985:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8a00, rc 0) 00000100:00100000:2.0:1788330100.457023:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+36:10397:x1875199729371264:12345-192.168.202.47@tcp:101:bash.0 Request processed in 4505us (4817us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788330100.457031:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:2.0:1788330100.464487:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.464643:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729371648 00000100:00100000:0.0:1788330100.464654:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729371648 00000100:00100000:0.0:1788330100.464725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 58 00000100:00100000:0.0:1788330100.464737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+36:10397:x1875199729371648:12345-192.168.202.47@tcp:36:bash.0 00010000:00010000:0.0:1788330100.465014:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.465033:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.465045:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330100.465095:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788330100.465117:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d3298564 reply state 0000000038d6264d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330100.465126:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330100.465212:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+39:10397:x1875199729371648:12345-192.168.202.47@tcp:36:bash.0 Request processed in 477us (732us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788330100.465221:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 58 00000020:00080000:0.0:1788330100.465226:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788330100.467843:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.467861:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.467870:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.467875:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330100.467880:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.467886:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.467904:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:2.0:1788330100.467907:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330100.467911:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.467917:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aac5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330100.471765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.471855:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729371776 00000100:00100000:0.0:1788330100.471866:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729371776 00000100:00100000:0.0:1788330100.471959:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:0.0:1788330100.471985:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+38:10397:x1875199729371776:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330100.472023:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330100.472043:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.472128:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.472143:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 39 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.472152:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.472188:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 39 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.472202:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 39 pid: 10120 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330100.472216:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750371584:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330100.472311:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330100.474565:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.474619:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729371904 00000100:00100000:1.0:1788330100.474635:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729371904 00010000:00010000:1.0:1788330100.474670:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 40 pid: 10120 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330100.474715:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:1.0:1788330100.474726:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+40:2347:x1875199729371904:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330100.474740:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330100.474747:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 40 pid: 10120 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.474761:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 40 pid: 10120 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.474781:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:1.0:1788330100.474784:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.474791:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.474796:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.474810:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330100.474855:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+40:2347:x1875199729371904:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 131us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330100.474862:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 41 00010000:00010000:3.0:1788330100.475131:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf0 expref: 39 pid: 10120 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330100.475153:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7f100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750371584:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330100.475175:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.475184:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.475190:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330100.475233:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788330100.475238:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330100.475258:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.475283:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf7 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.475293:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf7 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.475298:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:3.0:1788330100.475300:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330100.475308:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfa00, rc 0) 00000100:00100000:3.0:1788330100.475338:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+38:10397:x1875199729371776:12345-192.168.202.47@tcp:101:bash.0 Request processed in 3358us (3585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.475344:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:0.0:1788330100.482643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.482855:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729372160 00000100:00100000:3.0:1788330100.482864:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729372160 00000100:00100000:3.0:1788330100.482923:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:3.0:1788330100.482935:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+38:10397:x1875199729372160:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:3.0:1788330100.483184:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d57c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+39:10397:x1875199729372160:12345-192.168.202.47@tcp:35:bash.0 Request processed in 251us (552us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788330100.483193:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:1.0:1788330100.531906:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330100.532215:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729372416 00000100:00100000:2.0:1788330100.532226:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729372416 00000100:00100000:2.0:1788330100.532298:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:2.0:1788330100.532308:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+39:10407:x1875199729372416:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330100.532333:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330100.532355:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aac73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ebfe expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330100.532452:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788330100.532606:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aac73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebfe expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.532620:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:2.0:1788330100.532624:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330100.532630:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aac73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebfe expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330100.532643:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc800, rc 0) 00000100:00100000:2.0:1788330100.532842:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+40:10407:x1875199729372416:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 534us (945us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788330100.532850:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:2.0:1788330100.536912:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.538459:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729372544 00000100:00100000:3.0:1788330100.538476:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729372544 00000100:00100000:3.0:1788330100.538569:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:3.0:1788330100.538582:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+40:10407:x1875199729372544:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:3.0:1788330100.538677:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.538709:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.538724:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.538742:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.538749:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.538775:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539045:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539054:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539061:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330100.539102:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539115:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539122:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539129:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539136:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.539140:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539147:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539160:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330100.539168:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.539173:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539180:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aac81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539197:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539203:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539209:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539214:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.539217:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539223:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539231:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95468a2cc500) 00010000:00010000:3.0:1788330100.539234:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.539237:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539242:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aac88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539257:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539269:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539275:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539280:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.539283:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539289:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539298:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:3.0:1788330100.539300:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.539303:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.539308:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aac8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330100.539403:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+40:10407:x1875199729372544:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 822us (2499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.539411:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:0.0:1788330100.544411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.544493:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729372800 00000100:00100000:1.0:1788330100.544550:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729372800 00000100:00100000:1.0:1788330100.544604:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:1.0:1788330100.544619:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+40:10407:x1875199729372800:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:1.0:1788330100.544876:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+41:10407:x1875199729372800:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 257us (477us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788330100.544884:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:2.0:1788330100.600270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.600442:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729373056 00000100:00100000:0.0:1788330100.600456:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729373056 00000100:00100000:0.0:1788330100.600568:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 62 00000100:00100000:0.0:1788330100.600580:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+41:10410:x1875199729373056:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330100.600634:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330100.600661:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aac96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec05 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.600765:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.600782:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.600795:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.600811:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.600818:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.600825:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601122:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aacab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601131:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aacab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601138:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aacab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330100.601148:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788330100.601260:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601268:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601274:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601279:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330100.601284:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601290:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601302:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330100.601306:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330100.601310:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601316:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aac9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601328:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601334:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601340:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601345:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330100.601354:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601361:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601369:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6500) 00010000:00010000:0.0:1788330100.601371:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330100.601375:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601380:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaca4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601423:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aac96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec05 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601436:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aacab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec05 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.601444:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330100.601446:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330100.601449:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf800, rc 0) 00000100:00100000:0.0:1788330100.601569:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+43:10410:x1875199729373056:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 991us (1312us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1788330100.601576:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 62 00000100:00100000:2.0:1788330100.608259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.610587:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729373184 00000100:00100000:3.0:1788330100.610604:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729373184 00000100:00100000:3.0:1788330100.610675:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 63 00000100:00100000:3.0:1788330100.610686:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+43:10410:x1875199729373184:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:3.0:1788330100.610790:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610824:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610836:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610864:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610871:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610877:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610883:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.610888:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610895:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610908:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:3.0:1788330100.610912:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330100.610917:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.610923:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330100.611028:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+43:10410:x1875199729373184:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 343us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.611044:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 63 00000100:00100000:2.0:1788330100.611580:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.612060:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729373312 00000100:00100000:3.0:1788330100.612224:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729373312 00000100:00100000:3.0:1788330100.612351:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:3.0:1788330100.612361:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+43:2346:x1875199729373312:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330100.612375:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330100.612397:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aacab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec05 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.612413:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:3.0:1788330100.612418:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330100.612465:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+42:2346:x1875199729373312:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 105us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.612472:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:2.0:1788330100.617638:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.620950:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729373568 00000100:00100000:1.0:1788330100.620968:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729373568 00000100:00100000:1.0:1788330100.621317:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:1.0:1788330100.621331:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+42:10410:x1875199729373568:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:1.0:1788330100.621615:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+43:10410:x1875199729373568:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 286us (3988us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1788330100.621623:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:2.0:1788330100.864589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330100.864753:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729373824 00000100:00100000:0.0:1788330100.864765:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729373824 00000100:00100000:0.0:1788330100.864831:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:0.0:1788330100.864841:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+43:10428:x1875199729373824:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:0.0:1788330100.864883:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330100.864905:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aacc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec0c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.865019:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aacc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.865035:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aacc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.865048:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aacc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330100.865059:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788330100.866470:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aacc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec0c expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.866497:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aacc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec0c expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330100.866507:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330100.866510:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788330100.866514:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfe00, rc 0) 00000100:00100000:0.0:1788330100.866631:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10428:x1875199729373824:12345-192.168.202.47@tcp:101:cat.0 Request processed in 1790us (2051us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788330100.866640:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:2.0:1788330100.895272:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750371712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330100.895357:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330100.895545:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750371712 00000100:00100000:3.0:1788330100.895556:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750371712 00000100:00100000:3.0:1788330100.895631:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330100.895643:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750371712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330100.895688:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330100.895742:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750371712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.895749:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788330100.895799:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750371712:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788330100.895910:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330100.897353:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750372224:0@lo:400:kworker.0 00000100:00100000:2.0:1788330100.897424:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330100.897461:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330100.897468:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750372096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330100.897494:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330100.897884:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750371968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.897918:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330100.897986:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788330100.897992:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750371840:0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.898131:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330100.898166:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750372352:0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.898189:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330100.898221:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750372096 00000100:00100000:3.0:1788330100.898229:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750372096 00000100:00100000:3.0:1788330100.898272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750371968 00000100:00100000:3.0:1788330100.898275:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750371968 00000100:00100000:3.0:1788330100.898288:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750372352 00000100:00100000:3.0:1788330100.898290:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750372352 00000100:00100000:3.0:1788330100.898309:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330100.898318:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750372096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.898386:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750372096:12345-0@lo:400:kworker.0 Request processed in 69us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.898393:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788330100.898409:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788330100.898416:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750371968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.898447:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750371968:12345-0@lo:400:kworker.0 Request processed in 31us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.898453:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788330100.898464:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788330100.898470:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750372352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.898497:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf828700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750372352:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.898503:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788330100.898572:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750372352:0@lo:400:kworker.0 00000100:00100000:3.0:1788330100.898595:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750371968:0@lo:400:kworker.0 00000100:00100000:1.0:1788330100.898930:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750372224 00000100:00100000:1.0:1788330100.898947:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750372224 00000100:00100000:1.0:1788330100.898991:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330100.899009:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750372224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330100.899075:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750372224:12345-0@lo:400:kworker.0 Request processed in 78us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330100.899082:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1788330100.899393:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330100.899799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750371840 00000100:00100000:2.0:1788330100.899806:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750371840 00000100:00100000:2.0:1788330100.899854:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788330100.899862:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750371840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330100.899933:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750371840:12345-0@lo:400:kworker.0 Request processed in 62us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330100.899950:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1788330100.900016:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469dbb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750372096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330100.900032:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750372224:0@lo:400:kworker.0 00000100:00100000:0.0:1788330100.900476:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750371840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330100.919816:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.919938:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729373952 00000100:00100000:3.0:1788330100.919957:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729373952 00000100:00100000:3.0:1788330100.920023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:3.0:1788330100.920034:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10429:x1875199729373952:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330100.920059:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330100.920078:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec13 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.920147:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aacdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.920161:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aacdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.920173:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aacdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330100.920206:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788330100.920210:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330100.920227:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aacdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.920253:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec13 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.920275:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aacdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec13 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.920298:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330100.920300:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330100.920303:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9400, rc 0) 00000100:00100000:3.0:1788330100.920358:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10429:x1875199729373952:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 327us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.920363:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:2.0:1788330100.924993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.925187:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729374336 00000100:00100000:3.0:1788330100.925199:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729374336 00000100:00100000:3.0:1788330100.925259:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:3.0:1788330100.925270:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10429:x1875199729374336:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330100.925640:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10429:x1875199729374336:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 371us (657us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788330100.925648:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:2.0:1788330100.931145:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.931260:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729374464 00000100:00100000:1.0:1788330100.931272:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729374464 00000100:00100000:1.0:1788330100.931392:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:1.0:1788330100.931403:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10429:x1875199729374464:12345-192.168.202.47@tcp:103:lfs.0 00010000:00010000:1.0:1788330100.931418:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788330100.931446:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aac6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebf7 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.931480:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aacc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec0c expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.931494:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aab77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ebb8 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.931506:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6f00) 00010000:00010000:1.0:1788330100.931811:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330100.931872:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+44:10429:x1875199729374464:12345-192.168.202.47@tcp:103:lfs.0 Request processed in 470us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330100.931881:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:0.0:1788330100.934047:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330100.934286:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729374592 00000100:00100000:1.0:1788330100.934298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729374592 00000100:00100000:1.0:1788330100.934399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:1.0:1788330100.934410:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+44:10429:x1875199729374592:12345-192.168.202.47@tcp:58:lfs.0 00010000:00010000:1.0:1788330100.935991:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.936023:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330100.936037:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330100.936371:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330100.936597:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1788330100.936663:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1788330100.937133:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+44:10429:x1875199729374592:12345-192.168.202.47@tcp:58:lfs.0 Request processed in 2718us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330100.937145:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:2.0:1788330100.974834:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330100.974943:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729374720 00000100:00100000:3.0:1788330100.974965:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729374720 00000100:00100000:3.0:1788330100.975056:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 67 00000100:00100000:3.0:1788330100.975067:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+44:10431:x1875199729374720:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330100.975088:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330100.975109:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec1a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975182:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975196:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975224:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975240:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975246:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975251:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.975508:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976223:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976236:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330100.976273:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788330100.976277:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330100.976297:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976310:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976318:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976337:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976343:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976349:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.976354:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976361:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976374:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330100.976377:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.976381:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976387:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aacf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976405:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976411:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976416:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976421:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330100.976430:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976435:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976443:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95468a2cc500) 00010000:00010000:3.0:1788330100.976445:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330100.976448:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976453:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aacf8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976491:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aacea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976505:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330100.976512:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:3.0:1788330100.976515:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330100.978041:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8e00, rc 0) 00000100:00100000:3.0:1788330100.978129:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10431:x1875199729374720:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 3059us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330100.978139:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 67 00010000:00010000:1.0:1788330101.470657:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330101.599665:0:11989:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330101.599675:0:11989:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330101.599718:0:11989:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788330101.599726:0:11989:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788330101.600693:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330101.600700:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330101.600752:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788330101.600759:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788330101.600905:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78daa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750372480:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330101.602467:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330101.609723:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78daa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750372480:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788330101.613122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.613175:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729374848 00000100:00100000:3.0:1788330101.613185:0:5856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729374848 00000100:00080000:1.0:1788330101.613232:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330101.613292:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:3.0:1788330101.613305:0:5856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729374848:12345-192.168.202.47@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788330101.613399:0:5856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729374848:12345-192.168.202.47@tcp:900:lhsmtool_posix.0 Request processed in 96us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.613407:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:1.0:1788330101.618608:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.618652:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729374976 00000100:00100000:1.0:1788330101.618662:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729374976 00000100:00100000:1.0:1788330101.618730:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:1.0:1788330101.618740:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729374976:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788330101.618772:0:5845:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788330101.618893:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729374976:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 153us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330101.618901:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:0.0:1788330101.626921:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.626973:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729375104 00000100:00100000:3.0:1788330101.626985:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729375104 00000100:00100000:3.0:1788330101.627063:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00100000:3.0:1788330101.627074:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729375104:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788330101.627152:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.627169:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.627181:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.629834:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.629858:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.629870:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.629920:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.629929:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.629949:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330101.630010:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788330101.630014:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330101.630030:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630822:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630832:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630839:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630845:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330101.630849:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630857:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630873:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330101.630882:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330101.630887:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630894:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad06 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630907:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630914:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630919:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630925:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330101.630928:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630947:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630955:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff95468a2cc500) 00010000:00010000:3.0:1788330101.630957:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330101.630961:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630966:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad0d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.630981:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.631006:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.631012:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.631018:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330101.631021:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.631027:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.631446:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:3.0:1788330101.631451:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330101.631455:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.631462:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330101.631633:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729375104:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 Request processed in 4554us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.631645:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00100000:2.0:1788330101.643615:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.643842:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729375360 00000100:00100000:3.0:1788330101.643853:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729375360 00000100:00100000:3.0:1788330101.643925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 70 00000100:00100000:3.0:1788330101.644258:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10442:x1875199729375360:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330101.644287:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330101.644320:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad1b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec21 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644421:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644435:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644448:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330101.644459:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788330101.644845:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644855:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644862:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644905:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330101.644910:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644918:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.644931:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:3.0:1788330101.645026:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330101.645754:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.645781:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.645842:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad1b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec21 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.645854:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330101.645857:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330101.645861:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad1b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec21 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.645888:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8a00, rc 0) 00000100:00100000:3.0:1788330101.646409:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10442:x1875199729375360:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 2470us (2798us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788330101.646419:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 70 00000100:00100000:3.0:1788330101.657315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.660704:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729375488 00000100:00100000:1.0:1788330101.660722:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729375488 00000100:00100000:1.0:1788330101.660799:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 71 00000100:00100000:1.0:1788330101.660810:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10442:x1875199729375488:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788330101.660852:0:10120:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788330101.660983:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf828000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10442:x1875199729375488:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 174us (3681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330101.661002:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 71 00000100:00100000:1.0:1788330101.673904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330101.675187:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729375744 00000100:00100000:2.0:1788330101.675200:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729375744 00000100:00100000:2.0:1788330101.675268:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:2.0:1788330101.675278:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10442:x1875199729375744:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330101.675297:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330101.675300:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788330101.675345:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9aacdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec13 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.675364:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330101.675369:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330101.675383:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aad30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec28 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330101.676256:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788330101.676917:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aad37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.676934:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aad37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.676945:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aad37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.677020:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aad30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec28 expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.677039:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aad37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec28 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.677048:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606900) 00010000:00010000:2.0:1788330101.677063:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330101.677066:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd600, rc 0) 00000100:00100000:2.0:1788330101.677138:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10442:x1875199729375744:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1861us (3241us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788330101.677147:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:2.0:1788330101.681859:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330101.681896:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729376000 00000100:00100000:2.0:1788330101.681905:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729376000 00000100:00100000:2.0:1788330101.681961:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:2.0:1788330101.681971:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10442:x1875199729376000:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330101.682040:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330101.682067:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aad37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec28 expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682085:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606900) 00010000:00010000:2.0:1788330101.682095:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330101.682118:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682128:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682134:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682144:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682148:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682160:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682338:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682345:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682350:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682355:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330101.682359:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682366:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682374:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330101.682377:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330101.682380:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682385:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aad45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682393:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682398:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682412:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682416:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cde00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330101.682419:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682424:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682431:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x69aa33fe (ffff954692606500) 00010000:00010000:2.0:1788330101.682433:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330101.682435:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.682440:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aad4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x69aa33fe bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330101.682567:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10442:x1875199729376000:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 549us (671us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330101.682575:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:0.0:1788330101.688502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330101.688825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729376128 00000100:00100000:2.0:1788330101.688836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729376128 00000100:00100000:2.0:1788330101.689010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:2.0:1788330101.689022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10442:x1875199729376128:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330101.689044:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330101.689065:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aad53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.689107:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.689117:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.689125:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.689311:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aad53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.689380:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330101.689387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:2.0:1788330101.689390:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330101.689393:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc600, rc 0) 00000100:00100000:2.0:1788330101.689460:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10442:x1875199729376128:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 440us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330101.689467:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:0.0:1788330101.705994:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.706304:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729376384 00000100:00100000:3.0:1788330101.706315:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729376384 00000100:00100000:3.0:1788330101.706375:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:3.0:1788330101.706385:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10442:x1875199729376384:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330101.706467:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.706485:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.706497:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330101.706957:0:10120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788330101.706968:0:10120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356619449510ns, next at 357619447255ns, rc = 0 00000004:00010000:3.0:1788330101.707075:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002062e58b reply state 0000000058438eba transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330101.707086:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330101.707314:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10442:x1875199729376384:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 928us (1461us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788330101.707323:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:3.0:1788330101.711084:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.711226:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729376512 00000100:00100000:1.0:1788330101.711237:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729376512 00000100:00100000:1.0:1788330101.711304:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:1.0:1788330101.711322:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10442:x1875199729376512:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330101.711348:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330101.711370:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec36 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.711432:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.711448:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.711468:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:1.0:1788330101.711471:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330101.711476:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509000, rc 0) 00000100:00100000:1.0:1788330101.711566:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10442:x1875199729376512:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 244us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330101.711574:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 76 00010000:00010000:0.0:1788330101.712068:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330101.712079:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330101.712086:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330101.712093:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330101.712098:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330101.712106:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330101.712119:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:0.0:1788330101.712122:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330101.712126:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330101.712132:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9aad61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330101.715282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.715392:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729376640 00000100:00100000:1.0:1788330101.715403:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729376640 00000100:00100000:1.0:1788330101.715473:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:1.0:1788330101.715481:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875199729376640:12345-192.168.202.47@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788330101.715537:0:8194:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1788330101.715573:0:8194:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9aad6f 00002000:00100000:1.0:1788330101.715596:0:8194:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a815e47-382d-4064-91e8-23b9de97ce7e/ffff954692958000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788330101.715607:0:8194:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788330101.716059:0:8194:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788330101.716102:0:8194:0:(import.c:65:import_set_state_nolock()) ffff95469295a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330101.716177:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729376640:12345-192.168.202.47@tcp:8:lhsmtool_posix.0 Request processed in 694us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330101.716185:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:0.0:1788330101.724837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.724926:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729376768 00000100:00100000:1.0:1788330101.724946:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729376768 00000100:00100000:1.0:1788330101.725027:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:1.0:1788330101.725038:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:0:x1875199729376768:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788330101.725333:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330101.773458:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:0:x1875199729376768:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 48409us (48620us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788330101.773473:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 25 00000001:00080000:3.0:1788330101.774175:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788330101.774190:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000100:00100000:3.0:1788330101.775889:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330101.776413:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729377024 00000100:00100000:2.0:1788330101.776424:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729377024 00000100:00100000:2.0:1788330101.776485:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:2.0:1788330101.776496:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10442:x1875199729377024:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788330101.776962:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10442:x1875199729377024:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 465us (1076us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788330101.777406:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:2.0:1788330101.779480:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.780055:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729377280 00000100:00100000:3.0:1788330101.780066:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729377280 00000100:00100000:3.0:1788330101.780156:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 77 00000100:00100000:3.0:1788330101.780168:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10442:x1875199729377280:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788330101.780278:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10442:x1875199729377280:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 114us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.780284:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 77 00000100:00100000:2.0:1788330101.786197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.796535:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729377408 00000100:00100000:3.0:1788330101.796553:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729377408 00000100:00100000:3.0:1788330101.797133:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 78 00000100:00100000:3.0:1788330101.797145:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10442:x1875199729377408:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330101.797166:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330101.797193:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec3d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.797263:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.797278:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.797289:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330101.797326:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330101.797345:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.797370:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9aad76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec3d expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.797386:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec3d expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.797394:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:3.0:1788330101.797397:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788330101.799916:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9e00, rc 0) 00000100:00100000:3.0:1788330101.800028:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10442:x1875199729377408:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 2879us (13835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.800039:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 78 00000100:00100000:1.0:1788330101.815261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.815569:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729377536 00000100:00100000:1.0:1788330101.815580:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729377536 00000100:00100000:1.0:1788330101.815871:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:1.0:1788330101.815882:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729377536:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330101.815901:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330101.815925:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec44 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330101.815953:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c076, blocks: 0x1 00010000:00010000:1.0:1788330101.815971:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1788330101.815977:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330101.815996:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.816019:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.816046:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509400, rc 0) 00000100:00100000:1.0:1788330101.816100:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729377536:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 220us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330101.816107:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:0.0:1788330101.822148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.822493:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729377792 00000100:00100000:3.0:1788330101.822503:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729377792 00000100:00100000:3.0:1788330101.822895:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:3.0:1788330101.822906:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10442:x1875199729377792:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788330101.825677:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10442:x1875199729377792:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 2763us (3540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.825693:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:1.0:1788330101.829222:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.829308:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729377920 00000100:00100000:3.0:1788330101.829328:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729377920 00000100:00100000:3.0:1788330101.829394:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:3.0:1788330101.829405:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:10442:x1875199729377920:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330101.829431:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330101.829459:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec4b expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.829498:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.829509:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330101.829514:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330101.829558:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.829606:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.829634:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 7 pid: 6677 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330101.829679:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf828380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875199750372608:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330101.829807:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff954698312c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330101.833194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.833248:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729378048 00000100:00100000:1.0:1788330101.833260:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729378048 00010000:00010000:1.0:1788330101.833307:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 8 pid: 6677 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330101.833366:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:1.0:1788330101.833378:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a370c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729378048:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330101.833395:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330101.833419:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 8 pid: 6677 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.833437:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 8 pid: 6677 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.833466:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330101.833471:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330101.833481:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.833512:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.833574:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330101.833589:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bb31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875199750372736:192.168.202.47@tcp:105: 00000100:00100000:1.0:1788330101.833679:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8a80 going to sleep for 11 seconds 00010000:00010000:3.0:1788330101.834273:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078a16b36/0x91094de4de9aad84 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec44 expref: 8 pid: 6677 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330101.834285:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf828380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875199750372608:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330101.834302:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330101.834310:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9a00, rc 0) 00000100:00100000:3.0:1788330101.834341:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:10442:x1875199729377920:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 4939us (5130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.834349:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:3.0:1788330101.841161:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bb31180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5829:1875199750372736:192.168.202.47@tcp:105: 00010000:00010000:3.0:1788330101.841192:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330101.841260:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a370c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729378048:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 7884us (8085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330101.841274:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:0.0:1788330101.842208:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330101.842359:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729378176 00000100:00100000:2.0:1788330101.842368:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729378176 00002000:00100000:2.0:1788330101.842417:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9546bfd7ed80 x1875199729378176/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:117/0 lens 504/0 e 0 to 0 dl 1788330112 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788330101.842428:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfd7ed80 with x1875199729378176 ext(0->8) 00002000:00010000:2.0:1788330101.842434:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bfd7ed80 00000100:00100000:2.0:1788330101.842463:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:2.0:1788330101.842473:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729378176:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788330101.843322:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729378176:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 Request processed in 847us (1115us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788330101.843332:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00002000:00100000:2.0:1788330101.843340:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9546bfd7ed80 x1875199729378176/t4294967302(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:117/0 lens 504/448 e 0 to 0 dl 1788330112 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788330101.843348:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfd7ed80 with x1875199729378176 ext(0->8) 00002000:00010000:2.0:1788330101.843352:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bfd7ed80 00000100:00100000:0.0:1788330101.857443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330101.857543:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729378304 00000100:00100000:3.0:1788330101.857555:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729378304 00000100:00100000:3.0:1788330101.857627:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 80 00000100:00100000:3.0:1788330101.857639:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10442:x1875199729378304:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788330101.946132:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10442:x1875199729378304:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 Request processed in 88481us (88687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330101.946148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 80 00000001:00080000:3.0:1788330101.946492:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1788330101.946694:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788330101.946716:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788330101.946909:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000020:00080000:3.0:1788330101.947017:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9546a3369600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788330101.947021:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9546b4a4da00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9546a3369f00 00000020:00080000:3.0:1788330101.947024:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9546b4a4d800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9546bf4e9000 00000004:00080000:3.0:1788330101.947051:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788330101.947153:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1788330101.947270:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788330101.950209:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750372864:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788330101.950297:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330101.950683:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750372992:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788330101.950717:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330101.952209:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750372864 00000100:00100000:1.0:1788330101.952221:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750372864 00000100:00100000:2.0:1788330101.952226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330101.952289:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750372992 00000100:00100000:1.0:1788330101.952293:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750372992 00000100:00100000:1.0:1788330101.952306:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729378432 00000100:00100000:1.0:1788330101.952308:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729378432 00000100:00100000:1.0:1788330101.952325:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330101.952334:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750372864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788330101.952364:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788330101.952414:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a97c073, atime: 0x6a97c073, ctime: 0x6a97c073, blocks: 0x1 00010000:00010000:1.0:1788330101.952424:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.952441:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1788330101.952460:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330101.952467:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.952485:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.952495:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.952504:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.952543:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330101.952872:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330101.952883:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750372992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788330101.953019:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788330101.953023:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788330102 00002000:00010000:0.0:1788330101.953025:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788330101.953028:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788330102 -> 1788330102 00002000:00010000:0.0:1788330101.953030:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788330101.955067:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750372992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2180us (4341us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788330101.955080:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330101.955120:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:0.0:1788330101.955135:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729378432:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788330101.955333:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750372864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2998us (5034us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788330101.955342:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788330101.955362:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788330101.955370:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9546b78da680/2, rc 0, transno 4294967303 00010000:00010000:1.0:1788330101.955374:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788330101.955376:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750372992:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788330101.955381:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.955404:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330101.955409:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.955420:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.955449:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.955457:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9aad92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330101.955478:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330101.955479:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330101.955481:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788330101.955785:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469bb33100/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788330101.955792:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750372864:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788330102.032161:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788330102.032192:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:2.0:1788330102.032573:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729378432:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 Request processed in 77433us (80337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330102.032591:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:2.0:1788330102.036160:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330102.036695:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729378688 00000100:00100000:3.0:1788330102.036712:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729378688 00000100:00100000:3.0:1788330102.036796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:3.0:1788330102.036808:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+13:10442:x1875199729378688:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330102.036889:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330102.036927:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aad7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec3d expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.036955:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:3.0:1788330102.036960:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330102.037015:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.037032:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.037043:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330102.037430:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d99337b8 reply state 000000000c8c7ef4 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330102.037468:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330102.044937:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10442:x1875199729378688:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 8112us (8778us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788330102.044955:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 81 00010000:00010000:2.0:1788330102.049658:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.049683:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.049693:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.049700:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330102.049706:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.049716:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.049741:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:2.0:1788330102.049744:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330102.049750:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.049758:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9aad99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330102.050787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330102.051800:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729378816 00000100:00100000:3.0:1788330102.051814:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729378816 00000100:00100000:0.0:1788330102.052031:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:0.0:1788330102.052043:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729378816:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788330102.052339:0:8194:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788330102.052343:0:8194:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788330102 -> 1788330100 00002000:00010000:0.0:1788330102.052346:0:8194:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788330099 00002000:00010000:0.0:1788330102.052348:0:8194:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788330102 -> 1788330100 00002000:00010000:0.0:1788330102.052351:0:8194:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788330102.052430:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729378816:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 388us (1653us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788330102.052438:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:1.0:1788330102.054977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330102.055077:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379072 00000100:00100000:3.0:1788330102.055089:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379072 00000100:00100000:3.0:1788330102.055158:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 82 00000100:00100000:3.0:1788330102.055168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:10442:x1875199729379072:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788330102.055254:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.055273:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.055283:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.055338:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.055352:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 13 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330102.055367:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750373120:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330102.055461:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546983126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330102.058141:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330102.058203:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750373120:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330102.058244:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330102.058737:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379200 00000100:00100000:1.0:1788330102.058746:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379200 00010000:00010000:1.0:1788330102.058787:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 14 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330102.058826:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:1.0:1788330102.058835:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+14:2346:x1875199729379200:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330102.058849:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330102.058857:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 14 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.058870:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 14 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.058893:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aad5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec2f expref: 14 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.058924:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:1.0:1788330102.058929:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.058938:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.058945:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.058975:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330102.059040:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf828380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2346:x1875199729379200:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 205us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.059048:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 43 00010000:00010000:3.0:1788330102.060211:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060223:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060255:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060262:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060269:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060275:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330102.060279:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060287:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060302:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:3.0:1788330102.060305:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788330102.060309:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.060328:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aada0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330102.060409:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+12:10442:x1875199729379072:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 Request processed in 5240us (5440us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788330102.060429:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 82 00000100:00100000:1.0:1788330102.064076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330102.064177:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379328 00000100:00100000:0.0:1788330102.064188:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379328 00000100:00100000:0.0:1788330102.064340:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:0.0:1788330102.064352:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729379328:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788330102.064395:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.064415:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.064423:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330102.064428:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330102.064432:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.064468:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.064493:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 7 pid: 6678 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330102.064508:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875199750373248:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330102.064788:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546811c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330102.070364:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875199750373248:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330102.070399:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330102.071826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330102.073157:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379456 00000100:00100000:2.0:1788330102.073171:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379456 00010000:00010000:0.0:1788330102.073421:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330102.073499:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:0.0:1788330102.073511:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729379456:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330102.073561:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330102.073600:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.073617:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.073640:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9aad8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec4b expref: 8 pid: 6678 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.073658:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330102.073662:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330102.073668:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.073945:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.073982:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330102.074061:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729379456:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 551us (2240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.074069:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 44 00010000:00010000:1.0:1788330102.074173:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074183:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074208:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074229:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074250:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074257:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330102.074260:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074270:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074282:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.074290:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9aada7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330102.074356:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729379328:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 Request processed in 10007us (10291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330102.074366:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:1.0:1788330102.079617:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330102.079770:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379712 00000100:00100000:2.0:1788330102.079781:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379712 00000100:00100000:2.0:1788330102.079842:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 83 00000100:00100000:2.0:1788330102.079851:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+12:10442:x1875199729379712:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788330102.079929:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.079945:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.079956:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.080187:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.080198:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.080219:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.080269:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330102.080282:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 13 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330102.080298:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750373376:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330102.080474:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330102.083903:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750373376:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330102.083934:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330102.085977:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330102.086241:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379840 00000100:00100000:0.0:1788330102.086253:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379840 00010000:00010000:0.0:1788330102.086296:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 14 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330102.086340:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:0.0:1788330102.086350:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+14:2347:x1875199729379840:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330102.086366:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330102.086373:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 14 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.086389:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 14 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.086412:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aad68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec36 expref: 14 pid: 5845 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.086428:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:0.0:1788330102.086446:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.086456:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.086464:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.086491:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330102.086610:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729379840:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 262us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330102.086620:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 45 00010000:00010000:3.0:1788330102.086968:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.086977:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330102.087198:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788330102.087369:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788330102.087423:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788330102.087556:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10120:1875199750373504:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788330102.087618:0:10120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.087656:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5bc000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330102.087791:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750373504 00000100:00100000:2.0:1788330102.087798:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750373504 00000100:00100000:2.0:1788330102.087865:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330102.087875:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10120:x1875199750373504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788330102.087950:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10120:x1875199750373504:12345-0@lo:1000:mdt00_003.0 Request processed in 78us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330102.087958:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788330102.088956:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330102.089093:0:10120:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788330102.089102:0:10120:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9546b78da680, transno 4294967303 00000100:00100000:3.0:1788330102.089173:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10120:1875199750373504:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788330102.089968:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788330102.090068:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10120:1875199750373632:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788330102.090123:0:10120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.090185:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5bce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788330102.090871:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750373632 00000100:00100000:0.0:1788330102.090879:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750373632 00000100:00100000:1.0:1788330102.091033:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330102.091044:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10120:x1875199750373632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788330102.091299:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf828e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10120:x1875199750373632:12345-0@lo:1000:mdt00_003.0 Request processed in 256us (1174us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788330102.091312:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330102.091326:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:10120:1875199750373632:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788330102.091366:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091383:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091388:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091393:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cdc00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330102.091397:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091405:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091425:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff954692606e00) 00010000:00010000:3.0:1788330102.091430:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330102.091434:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091440:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aadb5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091481:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091487:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091492:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091497:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330102.091505:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091511:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091535:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:3.0:1788330102.091538:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330102.091542:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091548:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aace3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091572:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091720:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091732:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091763:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.091774:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 16 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330102.091786:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750373760:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330102.091849:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5bce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330102.094293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330102.094551:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729379968 00000100:00100000:3.0:1788330102.094563:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729379968 00010000:00010000:3.0:1788330102.094619:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 17 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330102.094665:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:3.0:1788330102.094675:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+17:2346:x1875199729379968:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330102.094883:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330102.094892:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 17 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.094907:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 17 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.094933:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:3.0:1788330102.094938:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.094950:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.094958:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330102.094995:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330102.095073:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9aacff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec1a expref: 17 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330102.095077:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+17:2346:x1875199729379968:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 403us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330102.095091:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:0.0:1788330102.095096:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750373760:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330102.095118:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.095957:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.095965:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.095974:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.095978:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.095982:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.095996:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330102.096001:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096008:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096022:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:1.0:1788330102.096026:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330102.096031:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096037:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aadbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096076:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096081:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096085:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096087:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330102.096089:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096092:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096097:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954689d7f700) 00010000:00010000:1.0:1788330102.096099:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330102.096100:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.096103:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aadae lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330102.096450:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330102.096461:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788330102.096476:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10442:x1875199729379712:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 16620us (16864us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788330102.096487:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 83 00000040:00080000:3.0:1788330102.096492:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000020:00080000:1.0:1788330102.096492:0:10120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788330102.096499:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330102.098347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330102.098419:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729380224 00000100:00100000:0.0:1788330102.098427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729380224 00000100:00100000:0.0:1788330102.098480:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:0.0:1788330102.098490:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10442:x1875199729380224:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788330102.099244:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788330102.099351:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788330102.099408:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.099424:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.099434:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.099440:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.099445:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.099449:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330102.099463:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330102.099589:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+17:10442:x1875199729380224:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 1099us (1245us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788330102.099598:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 20 00000020:00080000:0.0:1788330102.099603:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788330102.099933:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330102.099946:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.099952:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330102.099955:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.099961:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.099971:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9546a5cd6100) 00010000:00010000:1.0:1788330102.099972:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788330102.099975:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.099979:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aadc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330102.100000:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330102.100002:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330102.100004:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330102.495658:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330102.943185:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750373888:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330102.943299:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330102.943620:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750373888 00000100:00100000:3.0:1788330102.943630:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750373888 00000100:00100000:3.0:1788330102.943964:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788330102.943987:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750373888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330102.944036:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330102.944206:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750373888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 231us (906us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330102.944214:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788330102.945451:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750373888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788330103.522550:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330103.636357:0:12043:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788330103.636374:0:12043:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330103.636421:0:12043:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788330103.636429:0:12043:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330103.826707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330103.826854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729380480 00000100:00100000:0.0:1788330103.826870:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729380480 00000100:00100000:0.0:1788330103.826979:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 84 00000100:00100000:0.0:1788330103.826993:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+17:10461:x1875199729380480:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330103.827030:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330103.827059:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aadca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec52 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.827230:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aadd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.827248:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aadd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.827263:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aadd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330103.827276:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788330103.827466:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aadca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec52 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.827490:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aadd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec52 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.827500:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330103.827503:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330103.827506:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface000, rc 0) 00000100:00100000:0.0:1788330103.827612:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10461:x1875199729380480:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 621us (924us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1788330103.827620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 84 00000100:00080000:1.0:1788330103.827720:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330103.833337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330103.835041:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729380608 00000100:00100000:0.0:1788330103.835067:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729380608 00000100:00100000:0.0:1788330103.835184:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:0.0:1788330103.835199:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10461:x1875199729380608:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:0.0:1788330103.835341:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835388:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835404:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835427:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835436:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835443:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835827:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835837:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835846:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330103.835899:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835922:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835942:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835949:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330103.835954:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835962:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.835989:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330103.835994:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330103.836000:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836006:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaddf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836020:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836026:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836031:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836036:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330103.836039:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836057:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836067:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6500) 00010000:00010000:0.0:1788330103.836069:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330103.836072:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836078:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aade6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836095:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836101:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836107:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836112:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330103.836115:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836122:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836128:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330103.836130:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330103.836133:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.836149:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9aaded lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330103.836277:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10461:x1875199729380608:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 1079us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330103.836288:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:1.0:1788330103.899729:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330103.899986:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729380864 00000100:00100000:2.0:1788330103.900004:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729380864 00000100:00100000:2.0:1788330103.900097:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:2.0:1788330103.900111:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10464:x1875199729380864:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330103.900147:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330103.900178:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aadf4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900304:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900323:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900336:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900352:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900359:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900365:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900792:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900803:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900812:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330103.900824:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788330103.900949:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900958:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900989:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.900995:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330103.901000:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901008:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901023:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330103.901026:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330103.901031:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901038:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9aadfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901053:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901059:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901064:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901070:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330103.901072:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901090:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901099:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954692606500) 00010000:00010000:2.0:1788330103.901101:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330103.901103:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901109:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901166:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aadf4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901182:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.901189:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:2.0:1788330103.901191:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330103.901194:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd600, rc 0) 00000100:00100000:2.0:1788330103.901285:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10464:x1875199729380864:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1175us (1568us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788330103.901295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:3.0:1788330103.910877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330103.911000:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729380992 00000100:00100000:1.0:1788330103.911015:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729380992 00000100:00100000:1.0:1788330103.911106:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 87 00000100:00100000:1.0:1788330103.911120:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10464:x1875199729380992:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:1.0:1788330103.911228:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911250:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911265:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911300:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911309:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911316:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911324:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330103.911329:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911338:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911352:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:1.0:1788330103.911356:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330103.911375:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.911382:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330103.911492:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10464:x1875199729380992:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 373us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330103.911500:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 87 00000100:00100000:1.0:1788330103.914253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330103.914337:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729381248 00000100:00100000:0.0:1788330103.914352:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729381248 00000100:00100000:0.0:1788330103.914429:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:0.0:1788330103.914441:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10464:x1875199729381248:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330103.914862:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d56050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10464:x1875199729381248:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 421us (623us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788330103.914872:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:1.0:1788330103.966056:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330103.966733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729381504 00000100:00100000:2.0:1788330103.966751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729381504 00000100:00100000:2.0:1788330103.966852:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 88 00000100:00100000:2.0:1788330103.966867:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:9983:x1875199729381504:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330103.966917:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330103.966952:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aae1e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec60 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.967169:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.967193:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.967205:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.967265:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330103.967301:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 23 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330103.967323:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750374016:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330103.967476:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330103.982682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330103.982792:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750374016:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330103.982829:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330103.983284:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729381632 00000100:00100000:0.0:1788330103.983296:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729381632 00010000:00010000:0.0:1788330103.983353:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 24 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330103.983403:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 47 00000100:00100000:0.0:1788330103.983414:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+24:2347:x1875199729381632:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330103.983436:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330103.983444:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 24 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.983458:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 24 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.983510:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aae09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec59 expref: 24 pid: 5844 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.983561:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:0.0:1788330103.983568:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.983582:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.983592:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330103.983626:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330103.983705:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+23:2347:x1875199729381632:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 291us (1046us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330103.983716:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 47 00010000:00010000:1.0:1788330103.985481:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.985505:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330103.985563:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788330103.985845:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aae1e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.985872:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330103.985883:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:1.0:1788330103.985903:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788330103.985908:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc600, rc 0) 00000100:00100000:1.0:1788330103.986011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:9983:x1875199729381504:12345-192.168.202.47@tcp:101:bash.0 Request processed in 19146us (19978us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788330103.986021:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 88 00000100:00100000:1.0:1788330103.998474:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330103.998716:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729381888 00000100:00100000:3.0:1788330103.998731:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729381888 00000100:00100000:3.0:1788330103.998826:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 89 00000100:00100000:3.0:1788330103.998838:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+23:9983:x1875199729381888:12345-192.168.202.47@tcp:36:bash.0 00010000:00010000:3.0:1788330103.999257:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330103.999279:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330103.999294:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330103.999359:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1788330103.999396:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000052feb777 reply state 0000000019684dc4 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330103.999421:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788330103.999478:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1788330103.999654:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+27:9983:x1875199729381888:12345-192.168.202.47@tcp:36:bash.0 Request processed in 816us (1196us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1788330103.999662:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 89 00000020:00080000:3.0:1788330103.999667:0:10120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788330104.008635:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.008661:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.008670:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.008682:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330104.008688:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.008697:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.008708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:3.0:1788330104.008722:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:3.0:1788330104.008725:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330104.008730:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.008737:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.008753:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729382016 00000100:00100000:1.0:1788330104.008766:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729382016 00000100:00100000:1.0:1788330104.008832:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 90 00000100:00100000:1.0:1788330104.008845:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+26:9983:x1875199729382016:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:1.0:1788330104.008877:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.008904:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9aae3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec67 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.008997:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9aae3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec67 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.009014:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9aae3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec67 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.009039:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:1.0:1788330104.009042:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330104.009045:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509200, rc 0) 00000100:00100000:1.0:1788330104.009137:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+27:9983:x1875199729382016:12345-192.168.202.47@tcp:101:bash.0 Request processed in 294us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.009147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 90 00000100:00100000:1.0:1788330104.017765:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330104.018032:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729382144 00000100:00100000:2.0:1788330104.018048:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729382144 00000100:00100000:2.0:1788330104.018142:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:2.0:1788330104.018157:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:9983:x1875199729382144:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330104.018183:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330104.018213:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec6e expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788330104.018417:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:2.0:1788330104.018455:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a97c074, atime: 0x6a97c073, ctime: 0x6a97c074, blocks: 0xb 00010000:00010000:2.0:1788330104.018489:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788330104.018495:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330104.018507:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.018804:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 7 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.018825:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc800, rc 0) 00000100:00100000:2.0:1788330104.018921:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:9983:x1875199729382144:12345-192.168.202.47@tcp:101:bash.0 Request processed in 767us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330104.018930:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:3.0:1788330104.024291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.024839:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729382272 00000100:00100000:1.0:1788330104.024854:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729382272 00002000:00010000:1.0:1788330104.024916:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788330104.024921:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bf82ad80 with x1875199729382272 ext(0->18446744073709551615) 00002000:00010000:1.0:1788330104.024937:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bf82ad80. 00000100:00100000:1.0:1788330104.024984:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:1.0:1788330104.024997:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729382272:12345-192.168.202.47@tcp:10:bash.0 00002000:00010000:1.0:1788330104.025669:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788330104.025676:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788330100 -> 1788330104 00002000:00010000:1.0:1788330104.025679:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788330099 -> 1788330099 00002000:00010000:1.0:1788330104.025682:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788330100 -> 1788330104 00002000:00010000:1.0:1788330104.025684:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788330104.026041:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729382272:12345-192.168.202.47@tcp:10:bash.0 Request processed in 1040us (1762us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788330104.026053:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00002000:00010000:1.0:1788330104.026058:0:6682:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1788330104.026062:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bf82ad80 with x1875199729382272 ext(0->18446744073709551615) 00002000:00010000:1.0:1788330104.026069:0:6682:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bf82ad80. 00000100:00100000:1.0:1788330104.137758:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.138008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729382400 00000100:00100000:0.0:1788330104.138023:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729382400 00000100:00100000:0.0:1788330104.138116:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:0.0:1788330104.138129:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+27:10477:x1875199729382400:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:0.0:1788330104.138237:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138261:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138320:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138328:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138335:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138714:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138726:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.138734:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330104.139059:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139123:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139131:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139138:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139143:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.139148:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139165:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139180:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330104.139183:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330104.139188:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139195:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aae48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139208:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139213:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139218:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139223:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.139225:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139229:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139235:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330104.139237:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330104.139239:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139254:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aae4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139268:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139274:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139281:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139286:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.139289:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139294:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139303:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:0.0:1788330104.139304:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330104.139308:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.139314:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aae56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330104.139888:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+27:10477:x1875199729382400:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 1753us (2141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330104.139900:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:3.0:1788330104.207792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.208044:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729382656 00000100:00100000:1.0:1788330104.208060:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729382656 00000100:00100000:1.0:1788330104.208158:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 92 00000100:00100000:1.0:1788330104.208171:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+27:10481:x1875199729382656:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330104.208199:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.208246:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aae5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec75 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.208353:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.208371:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.208384:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.208403:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.208410:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.208417:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209066:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9aae72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209289:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9aae72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209300:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9aae72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330104.209313:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788330104.209443:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209461:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209468:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209474:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330104.209480:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209488:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209504:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:1.0:1788330104.209507:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330104.209512:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209546:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209562:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209568:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209575:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209580:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330104.209590:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209597:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209605:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954689d7f700) 00010000:00010000:1.0:1788330104.209607:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330104.209610:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.209616:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.210390:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aae5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec75 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.210415:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9aae72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec75 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.210423:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:1.0:1788330104.210426:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788330104.210430:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508200, rc 0) 00000100:00100000:1.0:1788330104.210694:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf828a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:10481:x1875199729382656:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 2523us (2931us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788330104.210706:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 92 00000100:00100000:2.0:1788330104.226201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330104.229853:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729382784 00000100:00100000:3.0:1788330104.229879:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729382784 00000100:00100000:3.0:1788330104.229994:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 93 00000100:00100000:3.0:1788330104.230007:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+29:10481:x1875199729382784:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:3.0:1788330104.230119:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.230140:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.230151:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.230200:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.230219:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 29 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330104.230237:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf829500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750374144:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330104.230388:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546983126c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330104.243307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.247397:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729383040 00000100:00100000:0.0:1788330104.247419:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729383040 00000100:00100000:0.0:1788330104.247571:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:0.0:1788330104.247584:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+30:5588:x1875199729383040:12345-192.168.202.47@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788330104.248108:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+31:5588:x1875199729383040:12345-192.168.202.47@tcp:35:ldlm_bl.0 Request processed in 522us (4818us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788330104.248116:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:3.0:1788330104.251373:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf829500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750374144:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330104.251419:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.256265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.256558:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729383168 00000100:00100000:0.0:1788330104.256573:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729383168 00010000:00010000:0.0:1788330104.256639:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 31 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330104.256760:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:0.0:1788330104.256786:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+31:2346:x1875199729383168:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330104.256811:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330104.256820:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 31 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.256836:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 31 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.256864:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aae25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec60 expref: 31 pid: 5844 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.256887:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:0.0:1788330104.256892:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.256926:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.256935:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.256976:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330104.257052:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+30:2346:x1875199729383168:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 269us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330104.257060:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 48 00010000:00010000:1.0:1788330104.257805:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257836:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257881:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257889:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257897:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257903:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330104.257909:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257920:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257937:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:1.0:1788330104.257939:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330104.257944:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.257950:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9aae80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.258049:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+29:10481:x1875199729382784:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 28039us (31862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.258060:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 93 00000100:00100000:1.0:1788330104.260105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.260242:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729383424 00000100:00100000:0.0:1788330104.260255:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729383424 00000100:00100000:0.0:1788330104.260327:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:0.0:1788330104.260339:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+29:10481:x1875199729383424:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330104.260711:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+30:10481:x1875199729383424:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 373us (617us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788330104.260720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:2.0:1788330104.385740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.385889:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729383680 00000100:00100000:1.0:1788330104.385906:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729383680 00000100:00100000:1.0:1788330104.386009:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 94 00000100:00100000:1.0:1788330104.386022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+30:10492:x1875199729383680:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:1.0:1788330104.386063:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.386102:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec7c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386208:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386227:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386242:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386260:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386268:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386276:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386918:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aae9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386931:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aae9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.386948:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aae9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330104.386961:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788330104.387351:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387361:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387369:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387375:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330104.387380:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387389:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387408:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:1.0:1788330104.387411:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330104.387417:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387423:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aae8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387438:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387444:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387457:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387463:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330104.387466:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387472:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387480:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954689d7f700) 00010000:00010000:1.0:1788330104.387482:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330104.387485:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387490:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aae95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387775:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aae87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec7c expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387794:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aae9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec7c expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.387803:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:1.0:1788330104.387805:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330104.387808:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509600, rc 0) 00000100:00100000:1.0:1788330104.387915:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:10492:x1875199729383680:12345-192.168.202.47@tcp:101:cat.0 Request processed in 1894us (2192us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788330104.387936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 94 00000100:00100000:2.0:1788330104.392806:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.392973:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729383936 00000100:00100000:0.0:1788330104.392988:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729383936 00000100:00100000:0.0:1788330104.393062:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:0.0:1788330104.393085:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:10492:x1875199729383936:12345-192.168.202.47@tcp:35:cat.0 00000100:00100000:0.0:1788330104.393425:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+33:10492:x1875199729383936:12345-192.168.202.47@tcp:35:cat.0 Request processed in 351us (637us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788330104.393435:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:3.0:1788330104.425680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.425932:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729384192 00000100:00100000:0.0:1788330104.425948:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729384192 00000100:00100000:0.0:1788330104.426103:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 95 00000100:00100000:0.0:1788330104.426117:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+33:10493:x1875199729384192:12345-192.168.202.47@tcp:36:rm.0 00010000:00010000:0.0:1788330104.426199:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788330104.426238:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aae9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec7c expref: 33 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426266:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9aae72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec75 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426280:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9aae3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec67 expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426292:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff954692606200) 00010000:00010000:0.0:1788330104.426304:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330104.426332:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426347:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426358:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426375:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426382:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426388:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426903:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426914:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.426922:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330104.427672:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788330104.427686:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359340168106ns, next at 360340164343ns, rc = 0 00010000:00010000:0.0:1788330104.434166:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434199:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434216:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434227:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434234:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434242:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434269:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330104.434313:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434340:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434347:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434354:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.434360:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434369:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434385:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6500) 00010000:00010000:0.0:1788330104.434389:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788330104.434395:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434401:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9aaeb8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434432:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434439:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434446:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434450:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.434460:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434466:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434475:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330104.434477:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330104.434480:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.434485:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaeaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330104.434496:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000641458b7 reply state 000000009ea4a2ca transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330104.434506:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330104.434682:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+32:10493:x1875199729384192:12345-192.168.202.47@tcp:36:rm.0 Request processed in 8560us (9024us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1788330104.434692:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 95 00010000:00010000:1.0:1788330104.435000:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330104.435009:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.435016:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330104.435020:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.435027:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.435037:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9546a5cd6500) 00010000:00010000:1.0:1788330104.435039:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788330104.435042:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.435047:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9aaebf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.435066:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330104.435069:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330104.435079:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330104.439373:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.439402:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.439411:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.439418:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.439425:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.439456:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.439484:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330104.439488:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330104.439495:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.439503:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaeb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330104.500101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.505782:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729384448 00000100:00100000:1.0:1788330104.505807:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729384448 00000100:00100000:1.0:1788330104.505925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 96 00000100:00100000:1.0:1788330104.505938:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+31:10499:x1875199729384448:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:1.0:1788330104.505986:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.506018:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaec6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec83 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.506238:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.506260:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.506277:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.506299:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.506306:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.506313:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330104.507154:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788330104.507402:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507415:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507426:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507479:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507501:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507509:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507572:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330104.507579:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507588:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507605:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:1.0:1788330104.507609:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330104.507617:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507624:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaecd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330104.507641:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006d38ff03 reply state 000000000b23a6bc transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.507653:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788330104.507700:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaec6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 34 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507716:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 33 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.507738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:1.0:1788330104.507741:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330104.507744:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508600, rc 0) 00000100:00100000:1.0:1788330104.507863:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+34:10499:x1875199729384448:12345-192.168.202.47@tcp:101:bash.0 Request processed in 1926us (7778us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788330104.507873:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 96 00000100:00100000:3.0:1788330104.513334:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330104.513407:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729384576 00000100:00100000:3.0:1788330104.513422:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729384576 00000100:00080000:2.0:1788330104.513502:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330104.513514:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 34 00010000:00010000:0.0:1788330104.513708:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.513725:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.513734:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.513742:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.513750:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.513759:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.513784:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954689d7f700) 00010000:00010000:0.0:1788330104.513788:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330104.513794:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.513829:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaed4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330104.514159:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729384576:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330104.514185:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330104.514213:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec8a expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330104.514246:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330104.514272:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788330104.514278:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330104.514290:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.514315:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.514330:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8a00, rc 0) 00000100:00100000:3.0:1788330104.514413:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729384576:12345-192.168.202.47@tcp:101:bash.0 Request processed in 263us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330104.520431:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:3.0:1788330104.521666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330104.522390:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729384704 00000100:00100000:3.0:1788330104.522408:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729384704 00000100:00100000:2.0:1788330104.522551:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:2.0:1788330104.522568:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:10499:x1875199729384704:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330104.522600:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330104.522630:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec91 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.522691:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.522702:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330104.522707:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330104.522713:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.524423:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.524462:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330104.524491:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875199750374272:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330104.524803:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330104.536348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330104.536493:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875199750374272:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330104.536577:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.536637:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cde00, rc 0) 00000100:00100000:3.0:1788330104.536723:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:10499:x1875199729384704:12345-192.168.202.47@tcp:101:bash.0 Request processed in 14158us (15467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330104.536734:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:0.0:1788330104.541425:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729384832 00000100:00100000:0.0:1788330104.541448:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729384832 00010000:00010000:0.0:1788330104.541532:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330104.541774:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:0.0:1788330104.541790:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729384832:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330104.541811:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330104.541845:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.541865:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.541900:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c836c5d5/0x91094de4de9aaee9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec8a expref: 9 pid: 6676 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.541924:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330104.541929:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330104.541939:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.541951:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.542038:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330104.542056:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875199750374400:192.168.202.47@tcp:105: 00000100:00100000:0.0:1788330104.542186:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330104.548003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330104.548048:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729385088 00000100:00100000:2.0:1788330104.548063:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729385088 00000100:00100000:2.0:1788330104.548151:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:2.0:1788330104.548163:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+33:10499:x1875199729385088:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:3.0:1788330104.548774:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875199750374400:192.168.202.47@tcp:105: 00010000:00010000:3.0:1788330104.548817:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330104.548885:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a370450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729384832:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 7099us (12548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330104.548895:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:2.0:1788330104.549596:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+34:10499:x1875199729385088:12345-192.168.202.47@tcp:35:bash.0 Request processed in 1429us (1608us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788330104.549608:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 25 00010000:00010000:1.0:1788330104.553050:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788330104.592784:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:1.0:1788330104.592807:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1788330104.647627:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330104.647682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.648221:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729385344 00000100:00100000:1.0:1788330104.648238:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729385344 00000100:00100000:1.0:1788330104.648323:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:1.0:1788330104.648336:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729385344:12345-192.168.202.47@tcp:16:kworker.0 00000100:00100000:1.0:1788330104.648609:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729385344:12345-192.168.202.47@tcp:16:kworker.0 Request processed in 274us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.648617:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:0.0:1788330104.651459:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729385216 00000100:00100000:0.0:1788330104.651590:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729385216 00002000:00100000:0.0:1788330104.651841:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9546b78d8e00 x1875199729385216/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:120/0 lens 504/0 e 0 to 0 dl 1788330115 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788330104.651855:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546b78d8e00 with x1875199729385216 ext(0->8) 00002000:00010000:0.0:1788330104.651863:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9546b78d8e00 00000100:00100000:1.0:1788330104.656211:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330104.656251:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729385216:12345-192.168.202.47@tcp:4:bash.0 00000100:00100000:1.0:1788330104.657042:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729385216:12345-192.168.202.47@tcp:4:bash.0 Request processed in 808us (9426us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788330104.657053:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00002000:00100000:1.0:1788330104.657066:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9546b78d8e00 x1875199729385216/t4294967302(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:120/0 lens 504/448 e 0 to 0 dl 1788330115 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330104.657090:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546b78d8e00 with x1875199729385216 ext(0->8) 00002000:00010000:1.0:1788330104.657098:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9546b78d8e00 00000100:00100000:3.0:1788330104.775696:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.775969:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729385472 00000100:00100000:1.0:1788330104.775989:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729385472 00000100:00100000:1.0:1788330104.776114:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 97 00000100:00100000:1.0:1788330104.776129:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+34:10515:x1875199729385472:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330104.776169:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.776207:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaef7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec98 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.776315:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aaefe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.776333:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aaefe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.776347:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aaefe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330104.776397:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788330104.776401:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330104.776428:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aaefe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.776460:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaef7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec98 expref: 36 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.776483:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aaefe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec98 expref: 35 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.776596:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:1.0:1788330104.776601:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330104.776605:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509e00, rc 0) 00000100:00100000:1.0:1788330104.776716:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf828380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+35:10515:x1875199729385472:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 590us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.776724:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 97 00000100:00100000:3.0:1788330104.792719:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.792874:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729385728 00000100:00100000:1.0:1788330104.792888:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729385728 00000100:00100000:1.0:1788330104.792968:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 98 00000100:00100000:1.0:1788330104.792978:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+35:10515:x1875199729385728:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330104.793004:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.793029:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaf05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ec9f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.793181:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.793195:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.793206:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330104.793217:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788330104.793380:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaf05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec9f expref: 38 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.793423:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec9f expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.793430:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:1.0:1788330104.793433:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330104.793436:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509000, rc 0) 00000100:00100000:1.0:1788330104.793567:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+37:10515:x1875199729385728:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 540us (818us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788330104.793575:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 98 00000100:00100000:3.0:1788330104.799501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330104.799623:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.799763:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729386112 00000100:00100000:1.0:1788330104.799777:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729386112 00000100:00100000:1.0:1788330104.799863:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:1.0:1788330104.799876:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+37:2346:x1875199729386112:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330104.799897:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330104.799932:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec9f expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.799967:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:1.0:1788330104.799974:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330104.800056:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+36:2346:x1875199729386112:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 182us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.800064:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:0.0:1788330104.800272:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729385984 00000100:00100000:0.0:1788330104.800278:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729385984 00000100:00100000:0.0:1788330104.800323:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 99 00000100:00100000:0.0:1788330104.800332:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+36:10515:x1875199729385984:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330104.800363:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330104.800384:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaf1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eca6 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.800510:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.800551:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.800565:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330104.800603:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788330104.800777:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9aaf1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eca6 expref: 39 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.800795:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eca6 expref: 38 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.800804:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:0.0:1788330104.800807:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788330104.800810:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf800, rc 0) 00000100:00100000:0.0:1788330104.800843:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+38:10515:x1875199729385984:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 513us (1219us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788330104.800851:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 99 00000100:00100000:2.0:1788330104.814796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330104.815017:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729386240 00000100:00100000:3.0:1788330104.815034:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729386240 00000100:00100000:3.0:1788330104.815277:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:3.0:1788330104.815291:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729386240:12345-192.168.202.47@tcp:1:lfs.0 00010000:00010000:3.0:1788330104.815363:0:8194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.815389:0:8194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.815399:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330104.815425:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330104.815431:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.815487:0:8194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330104.815505:0:8194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 8 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330104.815560:0:8194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8194:1875199750374528:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330104.816036:0:8194:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330104.820374:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330104.820681:0:8194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8194:1875199750374528:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330104.820722:0:8194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.822058:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729386368 00000100:00100000:1.0:1788330104.822087:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729386368 00010000:00010000:1.0:1788330104.822156:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.822234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:1.0:1788330104.822246:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2347:x1875199729386368:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330104.822267:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788330104.822296:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788330104.822300:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788330104 00002000:00010000:1.0:1788330104.822303:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788330104 00010000:00010000:1.0:1788330104.822309:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.822327:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.822358:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006de8c57c/0x91094de4de9aaef0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec91 expref: 9 pid: 6676 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.822382:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330104.822388:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330104.822395:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.822407:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.822455:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330104.822597:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729386368:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 352us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.822606:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 50 00010000:00010000:2.0:1788330104.823116:0:8194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823129:0:8194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823164:0:8194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823174:0:8194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823184:0:8194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823192:0:8194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330104.823197:0:8194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823207:0:8194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823222:0:8194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.823245:0:8194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000774ef779/0x91094de4de9aaf2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330104.830176:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729386240:12345-192.168.202.47@tcp:1:lfs.0 Request processed in 14866us (15391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330104.830197:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:3.0:1788330104.845674:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330104.845820:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729386624 00000100:00100000:2.0:1788330104.845835:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729386624 00000100:00100000:2.0:1788330104.845923:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:2.0:1788330104.845936:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+38:10515:x1875199729386624:12345-192.168.202.47@tcp:35:lfs.0 00000004:00010000:2.0:1788330104.846049:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eca6 expref: 38 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330104.846477:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1788330104.846557:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1788330104.846946:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1788330104.847031:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.847050:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.847060:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.847127:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.847159:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 42 pid: 5845 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330104.847179:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875199750374656:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330104.847304:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546983126c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330104.856200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.856352:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729386752 00000100:00100000:1.0:1788330104.856367:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729386752 00010000:00010000:1.0:1788330104.856422:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 43 pid: 5845 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330104.856475:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:1.0:1788330104.856485:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+43:2346:x1875199729386752:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330104.856507:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330104.856559:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 43 pid: 5845 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.856576:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 43 pid: 5845 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.856606:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:1.0:1788330104.856612:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.856624:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.856633:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.856653:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330104.856710:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+43:2346:x1875199729386752:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 226us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.856736:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 51 00010000:00010000:2.0:1788330104.856927:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9aaedb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec83 expref: 42 pid: 5845 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330104.856948:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875199750374656:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330104.856986:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.856998:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330104.857005:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330104.857319:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788330104.857703:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788330104.858670:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750374784:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788330104.858782:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330104.858819:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546811c89c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330104.863635:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750374784 00000100:00100000:2.0:1788330104.863662:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750374784 00000100:00100000:2.0:1788330104.863802:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788330104.863817:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875199750374784:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788330104.864029:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875199750374784:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 217us (5248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330104.864038:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788330104.864170:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330104.864179:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788330104.864188:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788330104.864213:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469bb33100, transno 4294967301 00000100:00100000:0.0:1788330104.864235:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750374784:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788330104.865462:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788330104.865654:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750374912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788330104.865753:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330104.865856:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546983126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330104.866011:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750374912 00000100:00100000:3.0:1788330104.866021:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750374912 00000100:00100000:3.0:1788330104.866089:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330104.866101:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875199750374912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788330104.866599:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875199750374912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 499us (844us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788330104.866608:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330104.866838:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750374912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788330104.866936:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788330104.867004:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.867016:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.867025:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.867030:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330104.867036:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.867043:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.867064:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:0.0:1788330104.867067:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788330104.867073:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330104.867079:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf36 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788330104.867409:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788330104.867645:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788330104.867659:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359780140714ns, next at 360780138329ns, rc = 0 00000001:00080000:0.0:1788330104.867667:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788330104.867724:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7f900) 00010000:00010000:0.0:1788330104.867728:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788330104.867737:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eca6 expref: 46 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330104.867888:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d57050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10515:x1875199729386624:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 21953us (22242us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788330104.867898:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 26 00000020:00080000:0.0:1788330104.867903:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788330104.872102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330104.872194:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729386880 00000100:00100000:1.0:1788330104.872208:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729386880 00000100:00100000:1.0:1788330104.872288:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 100 00000100:00100000:1.0:1788330104.872301:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:10515:x1875199729386880:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330104.872336:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330104.872367:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaf3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecad expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.872446:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaf3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecad expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.872463:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaf3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecad expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330104.872498:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330104.872502:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330104.872506:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509a00, rc 0) 00000100:00100000:1.0:1788330104.872613:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10515:x1875199729386880:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 314us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330104.872620:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 100 00000100:00100000:1.0:1788330104.876739:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330104.876937:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729387136 00000100:00100000:2.0:1788330104.876949:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729387136 00000100:00100000:2.0:1788330104.877078:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:2.0:1788330104.877091:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+46:10515:x1875199729387136:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:2.0:1788330104.877435:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10515:x1875199729387136:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 346us (708us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788330104.877444:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:3.0:1788330105.011207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330105.011391:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729387264 00000100:00100000:0.0:1788330105.011409:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729387264 00000100:00100000:0.0:1788330105.011570:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 101 00000100:00100000:0.0:1788330105.011586:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10525:x1875199729387264:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:0.0:1788330105.011722:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.011747:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.011778:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.011800:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.011808:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.011816:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.011994:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012003:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012011:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330105.012284:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012304:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012312:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012320:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012327:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330105.012333:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012347:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012365:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330105.012369:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330105.012376:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012395:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9aaf44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012416:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012423:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012428:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012431:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330105.012433:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012436:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012441:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330105.012443:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330105.012444:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012448:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012462:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012466:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012477:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012483:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330105.012486:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012493:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012500:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:0.0:1788330105.012503:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330105.012506:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.012512:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330105.012696:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10525:x1875199729387264:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 1108us (1498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330105.012708:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 101 00000100:00080000:1.0:1788330105.013383:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330105.072905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.073333:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729387520 00000100:00100000:1.0:1788330105.073348:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729387520 00000100:00100000:1.0:1788330105.073439:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 102 00000100:00100000:1.0:1788330105.073472:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+47:10528:x1875199729387520:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330105.073505:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330105.074078:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecb4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074198:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074219:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074234:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074253:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074259:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074266:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074432:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9aaf6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074441:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9aaf6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.074449:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9aaf6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330105.074478:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788330105.078786:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078810:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078819:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078825:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330105.078831:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078841:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078864:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330105.078867:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330105.078873:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078900:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9aaf60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078923:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078929:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078936:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078941:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330105.078944:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078951:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078968:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954689d7f400) 00010000:00010000:2.0:1788330105.078971:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330105.078974:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.078981:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9aaf67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.079062:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9aaf59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecb4 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.079080:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9aaf6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecb4 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.079094:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.079097:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330105.079100:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508800, rc 0) 00000100:00100000:2.0:1788330105.079220:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10528:x1875199729387520:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 5748us (6455us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788330105.079231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 102 00000100:00100000:2.0:1788330105.083886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.084296:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729387648 00000100:00100000:1.0:1788330105.084311:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729387648 00000100:00100000:2.0:1788330105.085687:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 103 00000100:00100000:2.0:1788330105.085726:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10528:x1875199729387648:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:2.0:1788330105.086013:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086038:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086053:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086094:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086102:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086109:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086116:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20ccc00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330105.086142:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086152:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086169:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.086173:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330105.086179:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.086186:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aaf7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330105.086308:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10528:x1875199729387648:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 602us (2438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330105.086318:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 103 00000100:00100000:1.0:1788330105.092902:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330105.093111:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729387904 00000100:00100000:0.0:1788330105.093125:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729387904 00000100:00100000:0.0:1788330105.093204:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:0.0:1788330105.093216:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+49:10528:x1875199729387904:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330105.097225:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10528:x1875199729387904:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 3992us (4320us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1788330105.097242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330105.157848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330105.157921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.158373:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729388288 00000100:00100000:1.0:1788330105.158386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729388288 00000100:00100000:1.0:1788330105.158479:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 133 00000100:00100000:1.0:1788330105.158489:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729388288:12345-192.168.202.47@tcp:400:kworker.0 00000100:00080000:2.0:1788330105.158513:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330105.158626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729388032 00000100:00100000:0.0:1788330105.158630:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729388032 00000100:00100000:0.0:1788330105.158662:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 289 00000100:00100000:0.0:1788330105.158667:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729388032:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330105.160509:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729388288:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 2001us (2566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.160542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 133 00000100:00100000:0.0:1788330105.161087:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729388032:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 2413us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330105.161100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 289 00000100:00100000:3.0:1788330105.161273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.161447:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729388160 00000100:00100000:1.0:1788330105.161458:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729388160 00000100:00100000:1.0:1788330105.161689:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:1.0:1788330105.161701:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729388160:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330105.161782:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729388160:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 84us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.161790:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:3.0:1788330105.214372:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.214681:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729388544 00000100:00100000:1.0:1788330105.214697:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729388544 00000100:00100000:0.0:1788330105.214978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 104 00000100:00100000:0.0:1788330105.214994:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+50:10538:x1875199729388544:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330105.215029:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330105.215033:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788330105.215071:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9aaefe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec98 expref: 50 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.215097:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330105.215104:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330105.215123:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf83 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecbb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.215287:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.215302:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.215313:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330105.215351:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788330105.215924:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9aaf83 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecbb expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.215945:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecbb expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330105.215965:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:0.0:1788330105.215968:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330105.215972:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface800, rc 0) 00000100:00100000:0.0:1788330105.216070:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10538:x1875199729388544:12345-192.168.202.47@tcp:101:bash.0 Request processed in 1079us (1711us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788330105.216079:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 104 00000100:00100000:3.0:1788330105.219986:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330105.220287:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729388800 00000100:00100000:2.0:1788330105.220302:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729388800 00000100:00100000:2.0:1788330105.220452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 105 00000100:00100000:2.0:1788330105.220466:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10538:x1875199729388800:12345-192.168.202.47@tcp:36:bash.0 00010000:00010000:2.0:1788330105.221204:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788330105.221247:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9aaf8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecbb expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.221439:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9aaf6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecb4 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.221452:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.221477:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330105.221970:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.221988:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.222000:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330105.222141:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788330105.222175:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000091a26bbe reply state 00000000b57503ee transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330105.222185:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330105.222451:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:10538:x1875199729388800:12345-192.168.202.47@tcp:36:bash.0 Request processed in 1985us (2491us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788330105.222463:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 105 00000020:00080000:2.0:1788330105.222469:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788330105.225177:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.225201:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.225210:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.225216:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330105.225223:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.225231:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.225285:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.225288:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330105.225293:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.225300:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aaf98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330105.227000:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330105.227457:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729388928 00000100:00100000:2.0:1788330105.227474:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729388928 00000100:00100000:2.0:1788330105.227578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 106 00000100:00100000:2.0:1788330105.227590:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+51:10538:x1875199729388928:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330105.227626:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330105.227661:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aaf9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecc2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.227787:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.227804:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.227819:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330105.227856:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788330105.227861:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330105.227883:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.227933:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aaf9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 53 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.227966:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 52 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.227977:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.227980:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330105.227984:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc600, rc 0) 00000100:00100000:2.0:1788330105.228053:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+52:10538:x1875199729388928:12345-192.168.202.47@tcp:101:bash.0 Request processed in 464us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330105.228197:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 106 00000100:00100000:0.0:1788330105.231344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330105.233208:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729389184 00000100:00100000:2.0:1788330105.233226:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729389184 00000100:00100000:2.0:1788330105.233465:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:2.0:1788330105.233476:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+52:10538:x1875199729389184:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:2.0:1788330105.233845:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+53:10538:x1875199729389184:12345-192.168.202.47@tcp:35:bash.0 Request processed in 370us (2515us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788330105.233854:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:3.0:1788330105.289860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.289965:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729389312 00000100:00100000:1.0:1788330105.289983:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729389312 00000100:00100000:1.0:1788330105.290060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 107 00000100:00100000:1.0:1788330105.290142:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+53:10544:x1875199729389312:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330105.290175:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330105.290198:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aafad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecc9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.290294:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aafb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.290309:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aafb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.290318:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aafb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330105.290354:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788330105.290357:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330105.290373:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aafb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.290394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9aafad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc9 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.290410:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aafb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc9 expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.290417:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:1.0:1788330105.290419:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330105.290423:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508c00, rc 0) 00000100:00100000:1.0:1788330105.290493:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+54:10544:x1875199729389312:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 354us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.290499:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 107 00000100:00100000:3.0:1788330105.293417:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330105.293569:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729389440 00000100:00100000:2.0:1788330105.293584:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729389440 00000100:00100000:2.0:1788330105.293670:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 108 00000100:00100000:2.0:1788330105.293681:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+54:10544:x1875199729389440:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330105.293706:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330105.293730:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aafbb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecd0 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.293837:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.293852:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.293863:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.293875:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.293880:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.293884:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294021:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294030:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294036:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330105.294083:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788330105.294088:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330105.294110:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294137:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294147:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294154:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294162:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294169:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330105.294174:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294181:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294192:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330105.294194:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330105.294197:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294202:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9aafc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294215:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294218:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294227:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294230:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330105.294232:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294235:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294240:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff954692606900) 00010000:00010000:2.0:1788330105.294241:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330105.294242:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294245:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9aafc9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294272:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9aafbb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 56 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294281:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 55 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.294287:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.294288:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330105.294290:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cdc00, rc 0) 00000100:00100000:2.0:1788330105.294424:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10544:x1875199729389440:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 743us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330105.294441:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 108 00000100:00100000:0.0:1788330105.299875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330105.300000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330105.300003:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729389696 00000100:00100000:2.0:1788330105.300017:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729389696 00000100:00100000:2.0:1788330105.300095:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 109 00000100:00100000:2.0:1788330105.300109:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10544:x1875199729389696:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330105.300138:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330105.300165:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aafd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecd7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.300308:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.300326:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.300335:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 56 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.300344:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.300404:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 56 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.300421:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 56 pid: 10120 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330105.300438:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc68a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750375040:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330105.300942:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.301102:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330105.301116:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc69500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750375168:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330105.301168:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330105.302821:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729389824 00000100:00100000:1.0:1788330105.302841:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729389824 00010000:00010000:1.0:1788330105.302920:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 57 pid: 10120 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330105.302982:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:1.0:1788330105.302994:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+57:2347:x1875199729389824:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330105.303013:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330105.303022:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 57 pid: 10120 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.303039:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 57 pid: 10120 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.303080:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330105.303085:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.303097:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.303103:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330105.303182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+57:2347:x1875199729389824:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 189us (3180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.303191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 52 00010000:00010000:3.0:1788330105.304023:0:5845:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.47@tcp) returned -22 from blocking AST (req@00000000b1efb833 x1875199750375040) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 56 pid: 10120 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330105.304049:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9aafd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd0 expref: 56 pid: 10120 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330105.304080:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc68a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750375040:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330105.307624:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc69500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750375168:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330105.307927:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.307936:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.307949:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.308951:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330105.310911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.311224:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729389952 00000100:00100000:1.0:1788330105.311238:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729389952 00010000:00010000:1.0:1788330105.311293:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330105.311358:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:1.0:1788330105.311390:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+56:2346:x1875199729389952:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330105.311432:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330105.311440:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.311455:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.311486:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9aafa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc2 expref: 56 pid: 5846 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.311507:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330105.311513:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.312812:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.312823:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.312869:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330105.312970:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:2346:x1875199729389952:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 1566us (2056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.312981:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 53 00010000:00010000:2.0:1788330105.313481:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.313495:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330105.313561:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788330105.313825:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9aafd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.313875:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.313898:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330105.313902:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330105.313906:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ec00, rc 0) 00000100:00100000:2.0:1788330105.313990:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10544:x1875199729389696:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 13884us (14133us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788330105.313998:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 109 00000100:00100000:2.0:1788330105.317287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.317494:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729390208 00000100:00100000:1.0:1788330105.317509:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729390208 00000100:00100000:1.0:1788330105.320180:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:1.0:1788330105.320197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10544:x1875199729390208:12345-192.168.202.47@tcp:103:lfs.0 00010000:00010000:1.0:1788330105.320238:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330105.320274:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaf3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecad expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.320301:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330105.320307:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330105.320399:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+54:10544:x1875199729390208:12345-192.168.202.47@tcp:103:lfs.0 Request processed in 206us (3123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.320408:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:0.0:1788330105.325007:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330105.326235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729390336 00000100:00100000:2.0:1788330105.326255:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729390336 00000100:00100000:2.0:1788330105.326368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 110 00000100:00100000:2.0:1788330105.326381:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+54:10544:x1875199729390336:12345-192.168.202.47@tcp:58:lfs.0 00010000:00010000:2.0:1788330105.326568:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.326593:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330105.326609:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330105.326975:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788330105.327122:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+54:10544:x1875199729390336:12345-192.168.202.47@tcp:58:lfs.0 Request processed in 740us (2130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330105.327133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 110 00000100:00100000:0.0:1788330105.332708:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330105.332830:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729390464 00000100:00100000:1.0:1788330105.332844:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729390464 00000100:00100000:1.0:1788330105.332929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 111 00000100:00100000:1.0:1788330105.332942:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+54:10544:x1875199729390464:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330105.332982:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330105.333013:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.333097:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.333110:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.333137:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.333152:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.333195:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330105.333199:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330105.333205:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330105.333213:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509a00, rc 0) 00000100:00100000:1.0:1788330105.333292:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10544:x1875199729390464:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 352us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330105.333299:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 111 00010000:00010000:1.0:1788330105.566982:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788330106.016586:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360929064869ns, next at 361929061145ns, rc = 0 00000100:00100000:0.0:1788330106.016857:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750375296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330106.017006:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330106.018229:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750375296 00000100:00100000:2.0:1788330106.018246:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750375296 00000100:00100000:2.0:1788330106.018368:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788330106.018381:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750375296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330106.018440:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330106.018558:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750375296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 180us (1551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.018566:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330106.019229:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750375680:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019296:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330106.019368:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330106.019375:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750375552:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019401:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330106.019430:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750375424:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019470:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330106.019499:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750375936:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019581:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330106.019601:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330106.019607:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750375808:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019635:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330106.019675:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750375424 00000100:00100000:1.0:1788330106.019683:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750375424 00000100:00100000:1.0:1788330106.019742:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788330106.019773:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750375424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019823:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750375424:12345-0@lo:400:kworker.0 Request processed in 52us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.019831:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788330106.019889:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750375424:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.019918:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750375680 00000100:00100000:1.0:1788330106.019922:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750375680 00000100:00100000:1.0:1788330106.019971:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750375552 00000100:00100000:1.0:1788330106.019975:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750375552 00000100:00100000:1.0:1788330106.019987:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750375936 00000100:00100000:1.0:1788330106.019990:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750375936 00000100:00100000:1.0:1788330106.020007:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330106.020013:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750375680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020080:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750375680:12345-0@lo:400:kworker.0 Request processed in 66us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.020089:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788330106.020102:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788330106.020107:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750375552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020134:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750375552:12345-0@lo:400:kworker.0 Request processed in 27us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.020140:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788330106.020149:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788330106.020155:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750375936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020183:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750375936:12345-0@lo:400:kworker.0 Request processed in 29us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.020189:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788330106.020230:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750375552:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020241:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750375680:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020265:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750375936:0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020283:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750375808 00000100:00100000:1.0:1788330106.020287:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750375808 00000100:00100000:1.0:1788330106.020317:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330106.020326:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750375808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330106.020367:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750375808:12345-0@lo:400:kworker.0 Request processed in 43us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.020373:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330106.020397:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750375808:0@lo:400:kworker.0 00000100:00080000:0.0:1788330106.021281:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330106.021290:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330106.021293:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330106.021348:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750375296:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788330106.207505:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330106.207545:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330106.207599:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788330106.207608:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788330106.207832:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750376064:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330106.208175:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0780 going to sleep for 11 seconds 00000100:00100000:0.0:1788330106.220487:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.220681:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729390592 00000100:00100000:1.0:1788330106.220698:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729390592 00000100:00100000:1.0:1788330106.220782:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 112 00000100:00100000:1.0:1788330106.220795:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729390592:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788330106.220842:0:5844:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788330106.221038:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729390592:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 245us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.221048:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 112 00000100:00100000:2.0:1788330106.221783:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750376064:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330106.226894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.227200:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729390720 00000100:00100000:3.0:1788330106.227216:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729390720 00000100:00100000:3.0:1788330106.227456:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 113 00000100:00100000:3.0:1788330106.227472:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10546:x1875199729390720:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788330106.227632:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227667:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227686:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227832:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227865:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227883:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227909:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227915:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227919:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330106.227969:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788330106.227973:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330106.227988:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.227998:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228002:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228006:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228010:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330106.228013:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228024:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228034:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330106.228036:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330106.228039:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228043:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9aaffa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228058:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228062:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228066:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228069:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330106.228070:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228073:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228077:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff95468a2ccb00) 00010000:00010000:3.0:1788330106.228078:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330106.228079:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228089:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab001 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228101:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228107:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228113:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228118:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330106.228121:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228127:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228135:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:3.0:1788330106.228137:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330106.228140:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.228145:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab008 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.228251:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10546:x1875199729390720:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 Request processed in 781us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330106.228260:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 113 00000100:00100000:0.0:1788330106.233867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.233965:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729390976 00000100:00100000:1.0:1788330106.233980:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729390976 00000100:00100000:1.0:1788330106.234065:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:1.0:1788330106.234078:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:10546:x1875199729390976:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330106.234122:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330106.234175:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab00f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ece5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234316:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234335:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234355:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330106.234368:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788330106.234491:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234498:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234504:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234508:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330106.234512:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234553:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234571:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330106.234574:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788330106.234579:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234597:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab016 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234655:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab00f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ece5 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234667:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:1.0:1788330106.234669:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330106.234673:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab00f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ece5 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.234684:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509600, rc 0) 00000100:00100000:1.0:1788330106.234772:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729390976:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 696us (921us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788330106.234781:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:0.0:1788330106.249891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.250042:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729391104 00000100:00100000:2.0:1788330106.250205:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729391104 00000100:00100000:2.0:1788330106.250278:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:2.0:1788330106.250289:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729391104:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330106.250340:0:5846:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330106.250481:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729391104:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 193us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.250490:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:0.0:1788330106.257731:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.258817:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729391360 00000100:00100000:1.0:1788330106.258835:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729391360 00000100:00100000:1.0:1788330106.258978:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 116 00000100:00100000:1.0:1788330106.258992:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729391360:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330106.259038:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330106.259043:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788330106.259095:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9aafb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecc9 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.259121:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:1.0:1788330106.259127:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330106.259169:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab024 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330106.259870:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788330106.260163:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab02b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.260182:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab02b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.260195:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab02b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.260270:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab024 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecec expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.260291:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab02b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecec expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.260300:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff954689d7f000) 00010000:00010000:1.0:1788330106.260303:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330106.260307:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509400, rc 0) 00000100:00100000:1.0:1788330106.260422:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+57:10546:x1875199729391360:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1432us (2708us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788330106.260433:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 116 00000100:00100000:0.0:1788330106.266717:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.266879:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729391616 00000100:00100000:2.0:1788330106.266896:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729391616 00000100:00100000:2.0:1788330106.266991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 117 00000100:00100000:2.0:1788330106.267005:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+57:10546:x1875199729391616:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330106.267126:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330106.267168:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9ab02b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecec expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267194:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff954689d7f000) 00010000:00010000:2.0:1788330106.267207:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330106.267242:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267260:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267271:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267289:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267296:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267303:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267403:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267411:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267418:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267433:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330106.267439:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267448:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267457:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:2.0:1788330106.267460:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330106.267464:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267469:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab039 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267482:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267487:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267492:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267498:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330106.267501:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267507:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267573:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xdfd5e647 (ffff954692606900) 00010000:00010000:2.0:1788330106.267576:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330106.267579:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.267585:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab040 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xdfd5e647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330106.267748:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729391616:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 742us (1045us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330106.267757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 117 00000100:00100000:3.0:1788330106.272306:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330106.272791:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729391744 00000100:00100000:0.0:1788330106.272808:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729391744 00000100:00100000:0.0:1788330106.272908:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 118 00000100:00100000:0.0:1788330106.272923:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+56:10546:x1875199729391744:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330106.272969:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330106.273007:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab047 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecf3 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.273288:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.273308:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.273323:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.273475:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab047 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.273499:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.273715:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330106.273719:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330106.273723:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface200, rc 0) 00000100:00100000:0.0:1788330106.273812:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+57:10546:x1875199729391744:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 892us (1525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330106.273820:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 118 00000100:00100000:2.0:1788330106.281413:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.281784:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729392000 00000100:00100000:3.0:1788330106.281800:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729392000 00000100:00100000:3.0:1788330106.281882:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:3.0:1788330106.281895:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+57:10546:x1875199729392000:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330106.282042:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.282181:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.282197:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330106.282801:0:10120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:3.0:1788330106.282934:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008761804c reply state 0000000035f0d019 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.282960:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330106.283870:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+59:10546:x1875199729392000:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 1965us (2462us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788330106.283884:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:2.0:1788330106.289437:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:3.0:1788330106.289568:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.289584:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.289593:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.289600:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330106.289606:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.289639:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.289671:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:3.0:1788330106.289675:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788330106.289680:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.289688:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab055 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.289966:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729392128 00000100:00100000:1.0:1788330106.289981:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729392128 00000100:00100000:1.0:1788330106.290077:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 120 00000100:00100000:1.0:1788330106.290091:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+58:10546:x1875199729392128:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330106.290134:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330106.290159:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ecfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.290236:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.290253:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.290277:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:1.0:1788330106.290280:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330106.290283:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509600, rc 0) 00000100:00100000:1.0:1788330106.291790:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+59:10546:x1875199729392128:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1683us (2353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.291806:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 120 00000100:00100000:2.0:1788330106.297434:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330106.297591:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729392256 00000100:00100000:0.0:1788330106.297607:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729392256 00000100:00100000:0.0:1788330106.297810:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00100000:0.0:1788330106.297823:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfa8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729392256:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788330106.298941:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfa8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2347:x1875199729392256:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 1110us (1515us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788330106.298964:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00080000:2.0:1788330106.301377:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330106.304196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.304445:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729392512 00000100:00100000:1.0:1788330106.304461:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729392512 00000100:00100000:1.0:1788330106.304599:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:1.0:1788330106.304613:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+59:10546:x1875199729392512:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788330106.304956:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+60:10546:x1875199729392512:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 333us (766us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788330106.304965:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:3.0:1788330106.320719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330106.321156:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729392768 00000100:00100000:0.0:1788330106.321175:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729392768 00000100:00100000:0.0:1788330106.321283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 121 00000100:00100000:0.0:1788330106.321297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:10546:x1875199729392768:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788330106.321511:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:10546:x1875199729392768:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 215us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330106.321588:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 121 00000100:00100000:0.0:1788330106.328680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.328803:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729392896 00000100:00100000:3.0:1788330106.328818:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729392896 00000100:00100000:3.0:1788330106.328902:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 122 00000100:00100000:3.0:1788330106.328915:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+60:10546:x1875199729392896:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330106.328958:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330106.328990:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab063 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed01 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.329116:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab06a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.329135:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.329149:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330106.329200:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330106.329249:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab06a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.329286:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab063 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed01 expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.329312:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab06a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed01 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.329323:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:3.0:1788330106.329326:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788330106.329331:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8e00, rc 0) 00000100:00100000:3.0:1788330106.329427:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+61:10546:x1875199729392896:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 515us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330106.329435:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 122 00000100:00100000:1.0:1788330106.335763:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.337510:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393024 00000100:00100000:2.0:1788330106.337615:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393024 00000100:00100000:2.0:1788330106.337857:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:2.0:1788330106.337872:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729393024:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330106.337898:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330106.337926:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed08 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330106.337972:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c07a, blocks: 0x1 00010000:00010000:2.0:1788330106.338001:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:2.0:1788330106.338007:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330106.338020:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 10 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.338064:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 10 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.338107:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cdc00, rc 0) 00000100:00100000:2.0:1788330106.338221:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2346:x1875199729393024:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 352us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.338229:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:3.0:1788330106.341970:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.342251:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393280 00000100:00100000:1.0:1788330106.342268:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393280 00000100:00100000:1.0:1788330106.342354:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 123 00000100:00100000:1.0:1788330106.342367:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+61:10546:x1875199729393280:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330106.342564:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+61:10546:x1875199729393280:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 198us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.342573:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 123 00000100:00100000:1.0:1788330106.347161:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330106.348006:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393408 00000100:00100000:0.0:1788330106.348031:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393408 00000100:00100000:3.0:1788330106.348906:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330106.348924:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+10:10546:x1875199729393408:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330106.348959:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330106.348985:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed0f expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.349040:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.349051:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330106.349056:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330106.349077:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.349124:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.349140:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.349158:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875199750376192:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330106.349274:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f803c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330106.354862:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875199750376192:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330106.354924:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.354966:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788330106.355061:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+11:10546:x1875199729393408:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 6140us (7914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330106.355072:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330106.355219:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.356055:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393536 00000100:00100000:2.0:1788330106.356068:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393536 00010000:00010000:2.0:1788330106.356120:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.356159:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:2.0:1788330106.356170:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a371450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+11:2346:x1875199729393536:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330106.356187:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330106.356218:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.356235:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.356269:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab071 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed08 expref: 11 pid: 6676 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.356289:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330106.356295:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330106.356305:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.356354:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.356401:0:8437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 10 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.356418:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8437:1875199750376320:192.168.202.47@tcp:105: 00000100:00100000:2.0:1788330106.356578:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330106.363370:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.364171:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393664 00000100:00100000:1.0:1788330106.364186:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393664 00002000:00100000:1.0:1788330106.364269:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9546bfd3c380 x1875199729393664/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:122/0 lens 504/0 e 0 to 0 dl 1788330117 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330106.364282:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfd3c380 with x1875199729393664 ext(0->12) 00002000:00010000:1.0:1788330106.364290:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bfd3c380 00000100:00100000:1.0:1788330106.364347:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:1.0:1788330106.364359:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+11:2347:x1875199729393664:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788330106.365226:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729393664:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 Request processed in 863us (1868us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788330106.365238:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 3 00002000:00100000:1.0:1788330106.365247:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9546bfd3c380 x1875199729393664/t4294967308(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:122/0 lens 504/448 e 0 to 0 dl 1788330117 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788330106.365250:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8437:1875199750376320:192.168.202.47@tcp:105: 00002000:00100000:1.0:1788330106.365263:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfd3c380 with x1875199729393664 ext(0->12) 00002000:00010000:1.0:1788330106.365268:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bfd3c380 00010000:00010000:2.0:1788330106.365282:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330106.365317:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a371450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+12:2346:x1875199729393536:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 9150us (10099us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.365326:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:1.0:1788330106.373063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.373480:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393792 00000100:00100000:3.0:1788330106.373501:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393792 00000100:00100000:3.0:1788330106.373668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 124 00000100:00100000:3.0:1788330106.373683:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+61:10546:x1875199729393792:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788330106.506778:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967392 is committed 00000004:00080000:2.0:1788330106.506810:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788330106.506834:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95469db7f3c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788330106.506841:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff954688e87d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff954584980180 00000020:00080000:2.0:1788330106.506844:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff954688e87600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9546bfd68000 00000004:00080000:2.0:1788330106.506861:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788330106.506889:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1788330106.506897:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:2.0:1788330106.506975:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788330106.506988:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95469b5bc000 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788330106.506991:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95468ab35e00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95469b5bc3c0 00000020:00080000:2.0:1788330106.507014:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95468ab35f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95469b52a400 00000100:00100000:1.0:1788330106.507493:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10546:x1875199729393792:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 Request processed in 133804us (134440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.507507:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 124 00000020:00080000:2.0:1788330106.508370:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:3.0:1788330106.510210:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750376448:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788330106.510325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330106.510462:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750376448 00000100:00100000:3.0:1788330106.510473:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750376448 00000100:00100000:3.0:1788330106.510587:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788330106.510599:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750376448:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788330106.510807:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788330106.510860:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a97c078, atime: 0x0, ctime: 0x6a97c078, blocks: 0x1 00010000:00010000:3.0:1788330106.510871:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.510893:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788330106.510899:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330106.510907:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.510929:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.510941:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.510961:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.510984:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330106.511166:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330106.511175:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.511184:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330106.511189:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.511198:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.511219:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.511226:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001ab267b9/0x91094de4de9ab07f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.511253:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330106.511255:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330106.511257:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788330106.512375:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788330106.513493:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330106.513567:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750376576:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788330106.513814:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330106.515406:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750376576 00000100:00100000:2.0:1788330106.515423:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750376576 00000100:00100000:2.0:1788330106.515502:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788330106.515539:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750376576:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788330106.515587:0:8194:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1788330106.515628:0:8194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.516284:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330106.516826:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750376448:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6224us (6497us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788330106.516839:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:2.0:1788330106.516917:0:8194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.516931:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788330106.516936:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330106.516979:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.517043:0:8194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 11 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.517063:0:8194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 11 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.517082:0:8194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8194:1875199750376704:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330106.517206:0:8194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330106.517881:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729393920 00000100:00100000:0.0:1788330106.517893:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729393920 00000100:00100000:3.0:1788330106.523429:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.523501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729394048 00000100:00100000:3.0:1788330106.523572:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729394048 00010000:00010000:3.0:1788330106.523638:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 13 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.523705:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:3.0:1788330106.523718:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729394048:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330106.523739:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330106.523746:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 13 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.523764:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 13 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.523805:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330106.523811:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330106.523819:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.523832:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.523860:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330106.523938:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729394048:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 222us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330106.523980:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:1.0:1788330106.524968:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:1.0:1788330106.525005:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+12:2347:x1875199729393920:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 00000004:00080000:1.0:1788330106.530374:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469bc69500/2, rc 0, transno 4294967304 00000100:00100000:1.0:1788330106.530429:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc69500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750376448:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1788330106.531017:0:8194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9aae41 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec6e expref: 12 pid: 6678 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.531059:0:8194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8194:1875199750376704:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330106.531095:0:8194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.531108:0:8194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.531116:0:8194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.531130:0:8194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.531138:0:8194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.531162:0:8194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788330106.532716:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750376576:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17192us (18891us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788330106.532735:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788330106.532804:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330106.532816:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.532844:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cdc00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330106.532851:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.532864:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.532893:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.532903:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059dea36c/0x91094de4de9ab086 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.532932:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330106.532934:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330106.532936:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788330106.541851:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469bc68a80/2, rc 0, transno 4294967309 00000100:00100000:1.0:1788330106.541895:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc68a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750376576:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788330106.590757:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788330106.665161:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1788330106.665325:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788330106.665340:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1788330106.666134:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729393920:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 Request processed in 141027us (149732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.666154:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:3.0:1788330106.669793:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.669999:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729394304 00000100:00100000:1.0:1788330106.670014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729394304 00000100:00100000:1.0:1788330106.670101:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 125 00000100:00100000:1.0:1788330106.670113:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10546:x1875199729394304:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788330106.670192:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330106.670230:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab06a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed01 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.670258:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:1.0:1788330106.670264:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330106.670305:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.670322:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.670333:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330106.670755:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007aa4a4cb reply state 00000000c34b69d2 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.670768:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330106.670919:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+16:10546:x1875199729394304:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 806us (1139us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788330106.670958:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 125 00010000:00010000:2.0:1788330106.674131:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.674159:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.674169:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.674197:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330106.674204:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.674213:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.674237:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:2.0:1788330106.674240:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330106.674245:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.674252:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab08d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.677238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.677680:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729394432 00000100:00100000:2.0:1788330106.677694:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729394432 00000100:00100000:2.0:1788330106.677773:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:2.0:1788330106.677786:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729394432:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788330106.678296:0:8194:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788330106.678302:0:8194:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788330105 00002000:00010000:2.0:1788330106.678305:0:8194:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788330105 00002000:00010000:2.0:1788330106.678307:0:8194:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788330106 -> 1788330105 00002000:00010000:2.0:1788330106.678310:0:8194:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788330106.678406:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729394432:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 620us (1184us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788330106.678416:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:3.0:1788330106.683011:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.683231:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729394688 00000100:00100000:1.0:1788330106.683245:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729394688 00000100:00100000:1.0:1788330106.683323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 126 00000100:00100000:1.0:1788330106.683335:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+15:10546:x1875199729394688:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788330106.683428:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.683450:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.683461:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.683505:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.683573:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 15 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.683591:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750376832:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330106.683756:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330106.689043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330106.689178:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729394816 00000100:00100000:0.0:1788330106.689191:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729394816 00010000:00010000:0.0:1788330106.689247:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 16 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330106.689300:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 56 00000100:00100000:0.0:1788330106.689313:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+16:2347:x1875199729394816:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330106.689347:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330106.689355:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 16 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.689373:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 16 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.689405:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330106.689411:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.689424:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.689460:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.689488:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330106.689606:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+16:2347:x1875199729394816:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 295us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330106.689615:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 56 00010000:00010000:1.0:1788330106.690692:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab04e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecf3 expref: 15 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.690719:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750376832:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330106.690767:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690779:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690785:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690827:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690834:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690842:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690849:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330106.690855:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690864:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690881:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:1.0:1788330106.690884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788330106.690889:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.690896:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab094 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.690996:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10546:x1875199729394688:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 Request processed in 7661us (8002us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788330106.691005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 126 00000100:00100000:3.0:1788330106.697492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.697691:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729394944 00000100:00100000:2.0:1788330106.697728:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729394944 00000100:00100000:2.0:1788330106.697818:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:2.0:1788330106.697833:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729394944:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788330106.697911:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.697938:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.697959:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330106.697964:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330106.697970:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.698033:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.698050:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 7 pid: 6677 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.698069:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875199750376960:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330106.698184:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5bc240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330106.702709:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.702922:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729395072 00000100:00100000:3.0:1788330106.702936:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729395072 00010000:00010000:3.0:1788330106.703001:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 8 pid: 6677 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.703052:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:3.0:1788330106.703063:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729395072:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330106.703082:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330106.703112:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 8 pid: 6677 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.703132:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 8 pid: 6677 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.703168:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330106.703173:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788330106.703181:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.703213:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.703242:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330106.703325:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729395072:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 262us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330106.703333:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 57 00010000:00010000:2.0:1788330106.704475:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9a71c9f/0x91094de4de9ab078 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed0f expref: 7 pid: 6677 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.704507:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875199750376960:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330106.704596:0:6678:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704610:0:6678:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704618:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704676:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704686:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704696:0:6678:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704705:0:6678:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330106.704711:0:6678:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704721:0:6678:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704742:0:6678:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.704757:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ff665bb/0x91094de4de9ab09b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.704858:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729394944:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 Request processed in 7027us (7386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.704869:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:0.0:1788330106.710290:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.710406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729395328 00000100:00100000:1.0:1788330106.710421:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729395328 00000100:00100000:1.0:1788330106.710499:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 127 00000100:00100000:1.0:1788330106.710512:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10546:x1875199729395328:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788330106.710677:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.710701:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.710715:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.711006:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.711020:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.711355:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.711407:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.711429:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 15 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.711473:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750377088:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330106.711639:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15540 going to sleep for 11 seconds 00000100:00100000:1.0:1788330106.718149:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750377088:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330106.718195:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330106.719394:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.719734:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729395456 00000100:00100000:1.0:1788330106.719747:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729395456 00010000:00010000:1.0:1788330106.719804:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 16 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.719860:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 58 00000100:00100000:1.0:1788330106.719872:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+16:2346:x1875199729395456:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330106.719892:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330106.719901:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 16 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.719918:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 16 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.719956:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab05c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecfa expref: 16 pid: 5844 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.719979:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:1.0:1788330106.719985:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.720016:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.720025:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.720065:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330106.720136:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+15:2346:x1875199729395456:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 265us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330106.720146:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 58 00010000:00010000:0.0:1788330106.721255:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.721273:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330106.721621:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788330106.721824:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788330106.721877:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788330106.722044:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf29a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750377216:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788330106.722137:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330106.722588:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330106.725457:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750377216 00000100:00100000:2.0:1788330106.725485:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750377216 00000100:00100000:0.0:1788330106.725847:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788330106.725863:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875199750377216:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788330106.726064:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875199750377216:12345-0@lo:1000:mdt00_002.0 Request processed in 204us (3927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330106.726074:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330106.726435:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1788330106.726444:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1788330106.726484:0:5846:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff95469bc68a80 x1875199750376576/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788330122 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330106.726501:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf29a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750377216:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788330106.727362:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788330106.727489:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750377344:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788330106.727618:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330106.727820:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff954584980000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330106.728176:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750377344 00000100:00100000:0.0:1788330106.728196:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750377344 00000100:00100000:0.0:1788330106.728270:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330106.728283:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875199750377344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788330106.728666:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875199750377344:12345-0@lo:1000:mdt00_002.0 Request processed in 383us (1046us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788330106.728677:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330106.729032:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b588e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750377344:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1788330106.729094:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729109:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729118:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729136:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330106.729143:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729152:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729182:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:1.0:1788330106.729185:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330106.729191:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729198:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0a9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729239:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729247:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729253:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729259:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330106.729263:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729269:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729290:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330106.729292:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330106.729301:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729316:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729327:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.729369:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330106.729384:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750377472:192.168.202.47@tcp:105: 00000100:00100000:1.0:1788330106.729489:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330106.733843:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330106.734659:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729395584 00000100:00100000:2.0:1788330106.734675:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729395584 00000100:00100000:2.0:1788330106.734752:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:2.0:1788330106.734777:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10544:x1875199729395584:12345-192.168.202.47@tcp:49:lfs.0 00000100:00100000:2.0:1788330106.734977:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10544:x1875199729395584:12345-192.168.202.47@tcp:49:lfs.0 Request processed in 214us (1154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.734985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:1.0:1788330106.737346:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750377472:192.168.202.47@tcp:105: 00010000:00010000:1.0:1788330106.737392:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.737407:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9aafec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.737459:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.737478:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.737970:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.737989:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.737997:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.738005:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.738012:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330106.738018:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739210:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739237:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330106.739241:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330106.739247:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739254:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab0b0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739275:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739283:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739309:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739316:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330106.739320:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739327:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739335:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330106.739338:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330106.739341:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330106.739347:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab0a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330106.740407:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+18:10546:x1875199729395328:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 29884us (30121us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1788330106.740424:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 127 00000020:00080000:2.0:1788330106.740432:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788330106.742630:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330106.743422:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330106.744481:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788330106.744501:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330106.751277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330106.751446:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729395840 00000100:00100000:1.0:1788330106.751461:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729395840 00000100:00100000:1.0:1788330106.751604:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 128 00000100:00100000:1.0:1788330106.751618:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+18:10544:x1875199729395840:12345-192.168.202.47@tcp:58:lfs.0 00000040:00080000:1.0:1788330106.752479:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788330106.753106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.754442:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729396096 00000100:00100000:3.0:1788330106.754460:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729396096 00000100:00100000:3.0:1788330106.754582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:3.0:1788330106.754595:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:10546:x1875199729396096:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788330106.755660:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:2.0:1788330106.756325:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+20:10544:x1875199729395840:12345-192.168.202.47@tcp:58:lfs.0 Request processed in 4700us (5055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330106.756342:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 128 00000001:00080000:3.0:1788330106.758125:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788330106.758242:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.758266:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.758281:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.758314:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.758322:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.758329:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.758360:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788330106.758510:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d54050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+20:10546:x1875199729396096:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 3910us (5402us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788330106.758554:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 32 00000020:00080000:3.0:1788330106.758561:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788330106.759261:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330106.759274:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.759300:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330106.759306:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.759316:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.759337:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff95468a2cc800) 00010000:00010000:2.0:1788330106.759340:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788330106.759345:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.759352:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330106.759374:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330106.759376:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330106.759378:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330106.800231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.800958:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729396224 00000100:00100000:3.0:1788330106.800973:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729396224 00000100:00100000:3.0:1788330106.801047:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 129 00000100:00100000:3.0:1788330106.801058:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+20:10548:x1875199729396224:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330106.801094:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330106.801125:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab0be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed16 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801212:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801226:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801237:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801267:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801272:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801276:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801675:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801686:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801693:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801728:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.801740:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 21 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.801756:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc20700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750377600:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330106.801895:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80300 going to sleep for 11 seconds 00000100:00100000:0.0:1788330106.807299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.807490:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc20700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750377600:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330106.807563:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729396480 00000100:00100000:2.0:1788330106.807574:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729396480 00010000:00010000:3.0:1788330106.807585:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330106.807727:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:0.0:1788330106.807739:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:5588:x1875199729396480:12345-192.168.202.47@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788330106.808205:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+23:5588:x1875199729396480:12345-192.168.202.47@tcp:35:ldlm_bl.0 Request processed in 466us (919us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1788330106.808215:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:0.0:1788330106.813830:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330106.814050:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729396608 00000100:00100000:3.0:1788330106.814066:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729396608 00010000:00010000:3.0:1788330106.814129:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 23 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330106.814227:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:3.0:1788330106.814240:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+23:2347:x1875199729396608:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330106.814260:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330106.814268:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 23 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.814285:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 23 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.814318:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9aafde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecd7 expref: 23 pid: 5845 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.814345:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:3.0:1788330106.814351:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.814363:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.814371:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330106.814412:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330106.814514:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:2347:x1875199729396608:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 275us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330106.814564:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 59 00010000:00010000:0.0:1788330106.814838:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.814849:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330106.814907:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788330106.814913:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330106.814951:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.814968:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.814980:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815002:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815010:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815017:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330106.815022:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815030:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815043:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:0.0:1788330106.815046:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330106.815050:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815056:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab0c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815071:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815078:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815084:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815090:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330106.815100:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815108:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815118:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff95468a2cc400) 00010000:00010000:0.0:1788330106.815121:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330106.815124:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815130:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab0cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815182:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab0be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed16 expref: 22 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815199:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed16 expref: 21 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330106.815207:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:0.0:1788330106.815210:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330106.815212:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8e00, rc 0) 00000100:00100000:0.0:1788330106.815269:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+21:10548:x1875199729396224:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 14211us (15054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330106.815277:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 129 00010000:00010000:3.0:1788330107.619232:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330107.646867:0:12094:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330107.646878:0:12094:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330107.647061:0:12094:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788330107.647068:0:12094:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788330107.808780:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330107.808806:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330107.808855:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788330107.808862:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788330107.809056:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750377728:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330107.809300:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5bc9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330107.816463:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330107.816665:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729396736 00000100:00100000:3.0:1788330107.816681:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729396736 00000100:00100000:3.0:1788330107.816776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 130 00000100:00100000:3.0:1788330107.816801:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10560:x1875199729396736:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788330107.816858:0:5844:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788330107.817034:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10560:x1875199729396736:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 247us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330107.817043:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 130 00000100:00080000:2.0:1788330107.817403:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330107.826091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330107.826341:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729396992 00000100:00100000:1.0:1788330107.826354:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729396992 00000100:00100000:1.0:1788330107.826423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 131 00000100:00100000:1.0:1788330107.826433:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+22:10560:x1875199729396992:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330107.826457:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330107.826505:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0da lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed1d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330107.826813:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330107.826829:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330107.826840:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330107.826851:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788330107.827020:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0da lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed1d expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330107.827042:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed1d expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330107.827052:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330107.827055:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330107.827059:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508a00, rc 0) 00000100:00100000:1.0:1788330107.827390:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+24:10560:x1875199729396992:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 956us (1310us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788330107.827397:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 131 00000100:00100000:2.0:1788330107.827605:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750377728:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788330107.843204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330107.843261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330107.843302:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729397376 00000100:00100000:3.0:1788330107.843329:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729397376 00000100:00100000:3.0:1788330107.843406:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 132 00000100:00100000:3.0:1788330107.843419:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:10560:x1875199729397376:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788330107.843571:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.843595:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.843610:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844087:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844109:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844115:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844119:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330107.844123:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844129:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844141:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:3.0:1788330107.844143:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330107.844147:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330107.844150:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab0ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330107.844454:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729397120 00000100:00100000:2.0:1788330107.844464:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729397120 00000100:00100000:2.0:1788330107.844559:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:2.0:1788330107.844572:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+25:2347:x1875199729397120:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330107.844592:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330107.844611:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed1d expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330107.844626:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330107.844641:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330107.845552:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+24:10560:x1875199729397376:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 2125us (2280us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1788330107.845565:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 132 00000100:00100000:2.0:1788330107.847051:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:2347:x1875199729397120:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 2466us (3847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330107.847068:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00000040:00080000:2.0:1788330107.847361:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330107.847366:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330107.847899:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788330107.847910:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330107.867976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330107.868752:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729397632 00000100:00100000:3.0:1788330107.868767:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729397632 00000100:00100000:3.0:1788330107.868852:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:3.0:1788330107.868866:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:10560:x1875199729397632:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788330107.869234:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+24:10560:x1875199729397632:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 368us (1276us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788330107.869252:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:0.0:1788330108.063728:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750377856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330108.063851:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330108.064020:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750377856 00000100:00100000:1.0:1788330108.064033:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750377856 00000100:00100000:1.0:1788330108.064136:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788330108.064148:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750377856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330108.064224:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788330108.064391:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330108.069109:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750377856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4946us (5241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330108.069132:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330108.073965:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b7c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750377856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330108.640900:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788330109.644748:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:2.0:1788330109.644770:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:3.0:1788330109.664991:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330109.957236:0:12148:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330109.957249:0:12148:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330109.957327:0:12148:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788330109.957335:0:12148:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330110.286490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330110.289319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330110.289361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330110.289392:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330110.289429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330110.289498:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398272 00000100:00100000:3.0:1788330110.289513:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398272 00000100:00100000:3.0:1788330110.289624:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729397888 00000100:00100000:3.0:1788330110.289628:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729397888 00000100:00100000:3.0:1788330110.289653:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 137 00000100:00100000:3.0:1788330110.289664:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729398272:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330110.289785:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729398272:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 122us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.289795:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 137 00000100:00100000:3.0:1788330110.289819:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 138 00000100:00100000:3.0:1788330110.289826:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:2346:x1875199729397888:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330110.289858:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:2346:x1875199729397888:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330110.289864:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 138 00000100:00100000:2.0:1788330110.291367:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398016 00000100:00100000:2.0:1788330110.291385:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398016 00000100:00100000:2.0:1788330110.291621:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398144 00000100:00100000:2.0:1788330110.291626:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398144 00000100:00100000:2.0:1788330110.291661:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:2.0:1788330110.291672:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729398016:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330110.291755:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729398016:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 84us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.291763:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:2.0:1788330110.291784:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00100000:2.0:1788330110.291791:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729398144:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330110.291818:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729398144:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 28us (2388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330110.291824:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00080000:2.0:1788330110.291843:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330110.291848:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330110.291850:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330110.292694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729397760 00000100:00100000:1.0:1788330110.292706:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729397760 00000100:00100000:1.0:1788330110.298722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 291 00000100:00100000:1.0:1788330110.298775:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729397760:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330110.298897:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729397760:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 160us (12428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330110.298916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 291 00000100:00100000:3.0:1788330110.349396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330110.349576:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398528 00000100:00100000:0.0:1788330110.349593:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398528 00000100:00100000:1.0:1788330110.349775:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 133 00000100:00100000:1.0:1788330110.349792:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:10580:x1875199729398528:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330110.349823:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330110.349853:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed24 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.350021:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.350041:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.350060:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330110.350074:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788330110.350287:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab0f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed24 expref: 27 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.350311:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed24 expref: 26 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330110.350722:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330110.350726:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788330110.350731:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508a00, rc 0) 00000100:00100000:1.0:1788330110.350821:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+26:10580:x1875199729398528:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1031us (1443us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1788330110.350830:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 133 00000100:00100000:3.0:1788330110.355430:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330110.359091:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398656 00000100:00100000:0.0:1788330110.359117:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398656 00000100:00100000:0.0:1788330110.359221:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 134 00000100:00100000:0.0:1788330110.359235:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+26:10580:x1875199729398656:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:0.0:1788330110.359341:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359364:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359377:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359412:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359419:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359426:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359433:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330110.359439:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359469:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359486:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:0.0:1788330110.359489:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330110.359494:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.359501:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfa00/0x91094de4de9ab10b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330110.359668:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+26:10580:x1875199729398656:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 435us (4252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.359677:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 134 00000100:00100000:2.0:1788330110.505730:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330110.505931:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398784 00000100:00100000:0.0:1788330110.505949:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398784 00000100:00100000:0.0:1788330110.506115:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:0.0:1788330110.506129:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2348:x1875199729398784:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:0.0:1788330110.506158:0:8194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330110.506188:0:8194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd668443/0x91094de4de9ab112 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed2b expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330110.506237:0:8194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a97c079, atime: 0x6a97c079, ctime: 0x6a97c079, blocks: 0xb 00010000:00010000:0.0:1788330110.506265:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:0.0:1788330110.506270:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330110.506282:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd668443/0x91094de4de9ab112 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed2b expref: 7 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.506330:0:8194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd668443/0x91094de4de9ab112 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed2b expref: 7 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330110.506349:0:8194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfa00, rc 0) 00000100:00100000:0.0:1788330110.506446:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2348:x1875199729398784:12345-192.168.202.47@tcp:101:cat.0 Request processed in 320us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330110.506454:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:3.0:1788330110.511599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330110.511693:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729398912 00000100:00100000:1.0:1788330110.511707:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729398912 00002000:00100000:1.0:1788330110.511836:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff95469ba4c700 x1875199729398912/t0(0) o3->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:126/0 lens 488/0 e 0 to 0 dl 1788330121 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330110.511848:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95469ba4c700 with x1875199729398912 ext(0->4095) 00002000:00010000:1.0:1788330110.511855:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95469ba4c700 00000100:00100000:1.0:1788330110.511893:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:1.0:1788330110.511919:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2349:x1875199729398912:12345-192.168.202.47@tcp:3:cat.0 00000100:00100000:1.0:1788330110.512324:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2349:x1875199729398912:12345-192.168.202.47@tcp:3:cat.0 Request processed in 409us (729us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788330110.512333:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00002000:00100000:1.0:1788330110.512340:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff95469ba4c700 x1875199729398912/t0(0) o3->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:126/0 lens 488/4536 e 0 to 0 dl 1788330121 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330110.512348:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95469ba4c700 with x1875199729398912 ext(0->4095) 00002000:00010000:1.0:1788330110.512368:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95469ba4c700 00010000:00010000:2.0:1788330110.686912:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330111.135039:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750378240:0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135149:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330111.135193:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750377984:0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135230:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788330111.135236:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330111.135237:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750378112:0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330111.135267:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750378496:0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135279:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750378624:0@lo:400:kworker.0 00000100:00100000:1.0:1788330111.135288:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330111.135303:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330111.135307:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330111.135312:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750378368:0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135339:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378624 00000100:00100000:2.0:1788330111.135349:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378624 00000100:00100000:1.0:1788330111.135351:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330111.135384:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750377984 00000100:00100000:1.0:1788330111.135388:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750377984 00000100:00100000:2.0:1788330111.135431:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378368 00000100:00100000:2.0:1788330111.135435:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378368 00000100:00100000:1.0:1788330111.135437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788330111.135447:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750377984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135454:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788330111.135460:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750378624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135506:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750378624:12345-0@lo:400:kworker.0 Request processed in 45us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330111.135506:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750377984:12345-0@lo:400:kworker.0 Request processed in 60us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330111.135515:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330111.135560:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1788330111.135569:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330111.135575:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750378368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330111.135597:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378240 00000100:00100000:1.0:1788330111.135600:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378240 00000100:00100000:2.0:1788330111.135603:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750378368:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330111.135609:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330111.135625:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378112 00000100:00080000:2.0:1788330111.135626:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330111.135628:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378112 00000100:00080000:2.0:1788330111.135632:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330111.135634:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330111.135639:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378496 00000100:00100000:1.0:1788330111.135641:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378496 00000100:00100000:1.0:1788330111.135660:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788330111.135666:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750378240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330111.135709:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750378240:12345-0@lo:400:kworker.0 Request processed in 43us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330111.135715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788330111.135726:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788330111.135740:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750378112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330111.135767:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750378112:12345-0@lo:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330111.135772:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788330111.135783:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788330111.135788:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750378496:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788330111.135800:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330111.135814:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750378496:12345-0@lo:400:kworker.0 Request processed in 26us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330111.135819:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788330111.135839:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000100:00100000:2.0:1788330111.135843:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750378112:0@lo:400:kworker.0 00000004:00080000:1.0:1788330111.135846:0:3315:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000100:00100000:2.0:1788330111.135854:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc68e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750378624:0@lo:400:kworker.0 00000100:00100000:2.0:1788330111.135861:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc69c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750378240:0@lo:400:kworker.0 00000004:00080000:1.0:1788330111.135873:0:3315:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469bc69500, transno 4294967304 00000100:00100000:1.0:1788330111.135884:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc68380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750378368:0@lo:400:kworker.0 00000100:00100000:1.0:1788330111.135893:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750377984:0@lo:400:kworker.0 00000100:00100000:1.0:1788330111.135912:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc69f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750378496:0@lo:400:kworker.0 00000004:00080000:3.0:1788330111.137106:0:7918:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366049586580ns, next at 367049583077ns, rc = 0 00000100:00100000:0.0:1788330111.137174:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788330111.137194:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750378752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330111.137255:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330111.137348:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378752 00000100:00100000:3.0:1788330111.137356:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378752 00000100:00100000:3.0:1788330111.137409:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330111.137418:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750378752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330111.137452:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330111.137514:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750378752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330111.137542:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788330111.137589:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750378752:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788330111.712147:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788330111.747100:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967409 is committed 00000001:00080000:2.0:1788330111.747122:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788330111.747135:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9546a0d150c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788330111.747140:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9546980fe400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9546a0d15540 00000020:00080000:2.0:1788330111.747144:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9546980fe500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9546bf4e8000 00000020:00080000:2.0:1788330111.747169:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:2.0:1788330111.747187:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:2.0:1788330111.747211:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:0.0:1788330111.749123:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750378880:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788330111.749235:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330111.749334:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750378880 00000100:00100000:0.0:1788330111.749345:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750378880 00000100:00100000:0.0:1788330111.749421:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000020:00080000:2.0:1788330111.749502:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788330111.749787:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750378880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788330111.750088:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788330111.750093:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788330105 -> 1788330105 00002000:00010000:0.0:1788330111.750096:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788330105 -> 1788330105 00002000:00010000:0.0:1788330111.750098:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788330105 -> 1788330105 00002000:00010000:0.0:1788330111.750100:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788330111.750163:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3314:x1875199750378880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 381us (928us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788330111.759494:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000004:00080000:0.0:1788330111.759641:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9546bfb7d500/2, rc 0, transno 4294967312 00000100:00100000:0.0:1788330111.759651:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750378880:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1788330111.780841:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788330111.780868:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:3.0:1788330112.734770:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330112.991081:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330112.991107:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330112.991155:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788330112.991164:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330113.187709:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330113.195082:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750379008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330113.195189:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330113.195573:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379008 00000100:00100000:1.0:1788330113.195585:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379008 00000100:00100000:1.0:1788330113.195659:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330113.195671:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750379008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330113.195718:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330113.195788:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750379008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330113.195796:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788330113.197655:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750379008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788330113.201667:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788330113.758753:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330114.782913:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330115.404105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330115.404160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330115.404196:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399040 00000100:00100000:2.0:1788330115.404208:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330115.404212:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399040 00000100:00100000:2.0:1788330115.404252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330115.404303:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330115.404347:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399552 00000100:00100000:2.0:1788330115.404352:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399552 00000100:00100000:1.0:1788330115.404392:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 293 00000100:00100000:2.0:1788330115.404406:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399168 00000100:00100000:1.0:1788330115.404407:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729399040:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330115.404412:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399168 00000100:00100000:2.0:1788330115.404443:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 142 00000100:00100000:2.0:1788330115.404454:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729399552:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330115.404584:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 143 00000100:00100000:3.0:1788330115.404594:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729399168:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330115.404679:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399296 00000100:00100000:0.0:1788330115.404685:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399296 00000100:00100000:0.0:1788330115.404727:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399424 00000100:00100000:0.0:1788330115.404730:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399424 00000100:00100000:0.0:1788330115.404768:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:0.0:1788330115.404777:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729399296:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330115.405398:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729399040:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 990us (1306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330115.405410:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 293 00000100:00100000:1.0:1788330115.405689:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:1.0:1788330115.405701:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729399424:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330115.410119:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2347:x1875199729399552:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 5642us (5885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330115.410142:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 142 00000100:00080000:2.0:1788330115.410233:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330115.410242:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330115.410247:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330115.411349:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729399424:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 5565us (6959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330115.411367:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:0.0:1788330115.415564:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729399296:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 10766us (11380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330115.415586:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:3.0:1788330115.421494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729399168:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 16878us (17218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330115.421553:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 143 00010000:00010000:0.0:1788330115.806895:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330116.254928:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330116.254962:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750379136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330116.255059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330116.255425:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750379648:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.255466:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330116.255499:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788330116.255506:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750379264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.255640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330116.255664:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750379776:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.255693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330116.255723:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750379392:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.255752:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330116.255774:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330116.255779:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750379520:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.255804:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330116.255836:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379776 00000100:00100000:0.0:1788330116.255845:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379776 00000100:00100000:0.0:1788330116.255930:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379392 00000100:00100000:0.0:1788330116.255934:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379392 00000100:00100000:0.0:1788330116.255951:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379520 00000100:00100000:0.0:1788330116.255954:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379520 00000100:00100000:0.0:1788330116.255975:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788330116.255987:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750379776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.256043:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750379776:12345-0@lo:400:kworker.0 Request processed in 60us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330116.256050:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788330116.256072:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788330116.256076:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750379392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.256095:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750379392:12345-0@lo:400:kworker.0 Request processed in 20us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330116.256099:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788330116.256106:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788330116.256110:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750379520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.256137:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750379520:12345-0@lo:400:kworker.0 Request processed in 27us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330116.256142:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:0.0:1788330116.256159:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330116.256189:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750379520:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.256196:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750379392:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.256236:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750379776:0@lo:400:kworker.0 00000100:00100000:3.0:1788330116.256359:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379648 00000100:00100000:3.0:1788330116.256363:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379648 00000100:00100000:3.0:1788330116.256405:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788330116.256414:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750379648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330116.256460:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750379648:12345-0@lo:400:kworker.0 Request processed in 49us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330116.256466:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788330116.256584:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379136 00000100:00100000:1.0:1788330116.256590:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379136 00000100:00100000:1.0:1788330116.256628:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330116.256633:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750379136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330116.256665:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330116.256711:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1875199750379136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (1654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330116.256715:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330116.256739:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379264 00000100:00100000:1.0:1788330116.256742:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379264 00000100:00100000:1.0:1788330116.256769:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1788330116.256776:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750379264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330116.256809:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750379264:12345-0@lo:400:kworker.0 Request processed in 34us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330116.256815:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1788330116.257756:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1788330116.257766:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469bc68a80, transno 4294967309 00000004:00080000:2.0:1788330116.257785:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1788330116.257814:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9546bfb7d500 x1875199750378880/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788330127 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330116.257861:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750379136:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788330116.258983:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330116.258994:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330116.259036:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750379264:0@lo:400:kworker.0 00000100:00100000:0.0:1788330116.259056:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750379648:0@lo:400:kworker.0 00000020:00080000:2.0:1788330116.801780:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788330116.801862:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788330116.801892:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1788330116.802047:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1788330116.831017:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330117.114915:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330117.115128:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399680 00000100:00100000:0.0:1788330117.115144:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399680 00000100:00100000:0.0:1788330117.115268:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 135 00000100:00100000:0.0:1788330117.115284:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+13:10224:x1875199729399680:12345-192.168.202.47@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788330117.115461:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+13:10224:x1875199729399680:12345-192.168.202.47@tcp:60:lhsmtool_posix.0 Request processed in 181us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330117.115470:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 135 00000100:00080000:2.0:1788330117.115574:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330117.129992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330117.130169:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729399936 00000100:00100000:1.0:1788330117.130181:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729399936 00000100:00100000:1.0:1788330117.130257:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:1.0:1788330117.130269:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:10224:x1875199729399936:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788330117.130976:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+14:10224:x1875199729399936:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 706us (993us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788330117.130985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:1.0:1788330117.365007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330117.365105:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400064 00000100:00100000:0.0:1788330117.365115:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400064 00000100:00100000:0.0:1788330117.365182:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 136 00000100:00100000:0.0:1788330117.365190:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:11033:x1875199729400064:12345-192.168.202.47@tcp:101:lsof.0 00010000:00010000:0.0:1788330117.365208:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330117.365230:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab119 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed32 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330117.365309:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330117.365334:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330117.365352:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330117.365391:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788330117.365394:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330117.365435:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330117.365461:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab119 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330117.365480:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 6 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330117.365490:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:0.0:1788330117.365492:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330117.365495:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf400, rc 0) 00000100:00100000:0.0:1788330117.365625:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+6:11033:x1875199729400064:12345-192.168.202.47@tcp:101:lsof.0 Request processed in 434us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330117.365633:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 136 00000100:00080000:2.0:1788330117.365795:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788330117.854846:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330118.307707:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750379904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330118.307822:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330118.310091:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750379904 00000100:00100000:3.0:1788330118.310107:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750379904 00000100:00100000:3.0:1788330118.310205:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788330118.310216:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750379904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330118.310257:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330118.310351:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750379904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330118.310360:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:2.0:1788330118.310442:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330118.311761:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750379904:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788330118.879360:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330119.902915:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330120.517245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330120.517284:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330120.517330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330120.517361:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330120.517403:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330120.517492:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400448 00000100:00100000:0.0:1788330120.517501:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400448 00000100:00100000:0.0:1788330120.517598:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400576 00000100:00100000:0.0:1788330120.517601:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400576 00000100:00100000:0.0:1788330120.517629:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:0.0:1788330120.517640:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729400448:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330120.517724:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729400448:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 86us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330120.517731:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:0.0:1788330120.517751:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:0.0:1788330120.517758:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729400576:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330120.517783:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729400576:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 26us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330120.517789:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:0.0:1788330120.517840:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400704 00000100:00100000:0.0:1788330120.517845:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400704 00000100:00100000:0.0:1788330120.517879:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400320 00000100:00100000:0.0:1788330120.517883:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400320 00000100:00100000:0.0:1788330120.517901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 147 00000100:00100000:0.0:1788330120.517907:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729400704:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330120.517935:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729400704:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 29us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330120.517941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 147 00000100:00100000:0.0:1788330120.517965:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 148 00000100:00100000:0.0:1788330120.517971:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:2346:x1875199729400320:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330120.518002:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:2346:x1875199729400320:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 31us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330120.518008:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 148 00000100:00100000:1.0:1788330120.518433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400192 00000100:00100000:1.0:1788330120.518438:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400192 00000100:00100000:1.0:1788330120.518480:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 295 00000100:00100000:1.0:1788330120.518487:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729400192:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330120.518555:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729400192:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 68us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330120.518562:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 295 00000100:00080000:2.0:1788330120.520218:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330120.520227:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330120.520230:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788330120.926916:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330121.375106:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750380288:0@lo:400:kworker.0 00000100:00100000:2.0:1788330121.375194:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330121.375260:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788330121.375267:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750380160:0@lo:400:kworker.0 00000100:00100000:2.0:1788330121.375291:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330121.375308:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750380672:0@lo:400:kworker.0 00000100:00100000:2.0:1788330121.375367:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330121.375478:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750380416:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.375565:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330121.375588:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788330121.375594:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750380032:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.375623:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330121.375641:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750380544:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.375661:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330121.375709:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380288 00000100:00100000:0.0:1788330121.375716:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380288 00000100:00100000:0.0:1788330121.375772:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380160 00000100:00100000:0.0:1788330121.375775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380160 00000100:00100000:0.0:1788330121.375789:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380544 00000100:00100000:0.0:1788330121.375791:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380544 00000100:00100000:0.0:1788330121.375820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788330121.375829:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750380288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.375902:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750380288:12345-0@lo:400:kworker.0 Request processed in 73us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330121.375910:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788330121.375929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788330121.375935:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750380160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.375962:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750380160:12345-0@lo:400:kworker.0 Request processed in 28us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330121.375975:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788330121.375988:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788330121.375994:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750380544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376025:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750380544:12345-0@lo:400:kworker.0 Request processed in 31us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330121.376031:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788330121.376053:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380672 00000100:00100000:0.0:1788330121.376057:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380672 00000100:00100000:0.0:1788330121.376082:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380416 00000100:00100000:0.0:1788330121.376085:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380416 00000100:00100000:0.0:1788330121.376101:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330121.376107:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750380672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376138:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750380672:12345-0@lo:400:kworker.0 Request processed in 32us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330121.376144:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330121.376154:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788330121.376160:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376184:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750380416:12345-0@lo:400:kworker.0 Request processed in 25us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330121.376190:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788330121.376208:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330121.376212:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330121.376214:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330121.376239:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750380544:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376249:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750380416:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376279:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750380160:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376300:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1788330121.376305:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9546bfb7d500, transno 4294967312 00000100:00100000:0.0:1788330121.376316:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750380672:0@lo:400:kworker.0 00000100:00100000:0.0:1788330121.376326:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750380288:0@lo:400:kworker.0 00000100:00100000:3.0:1788330121.377424:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330121.377438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750380800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330121.377483:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330121.377739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380032 00000100:00100000:1.0:1788330121.377746:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380032 00000100:00100000:1.0:1788330121.377794:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788330121.377812:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750380032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330121.377882:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750380032:12345-0@lo:400:kworker.0 Request processed in 82us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330121.377889:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788330121.377923:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380800 00000100:00100000:1.0:1788330121.377926:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380800 00000100:00100000:1.0:1788330121.377965:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330121.377971:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750380800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330121.377996:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330121.378029:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750380800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330121.378036:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330121.378097:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf829c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750380032:0@lo:400:kworker.0 00000100:00100000:3.0:1788330121.378790:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546beff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750380800:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788330121.952694:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788330121.958505:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000040:00080000:2.0:1788330122.212860:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330122.212870:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330122.215024:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788330122.215038:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788330122.976707:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330123.423775:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330123.423811:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750380928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330123.423886:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330123.423992:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750380928 00000100:00100000:0.0:1788330123.424000:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750380928 00000100:00100000:0.0:1788330123.424062:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330123.424072:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750380928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330123.424104:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330123.424149:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dcdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750380928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330123.424156:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330123.424387:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750380928:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788330123.424514:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788330123.426534:0:12354:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 02:22:01 (1788330121) 00010000:00010000:3.0:1788330123.998907:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330125.025800:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330125.651212:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330125.651315:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330125.651352:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330125.651385:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330125.651412:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330125.651440:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400960 00000100:00100000:0.0:1788330125.651451:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400960 00000100:00100000:0.0:1788330125.651509:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401344 00000100:00100000:0.0:1788330125.651512:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401344 00000100:00100000:2.0:1788330125.652877:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401216 00000100:00100000:2.0:1788330125.652905:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401216 00000100:00100000:2.0:1788330125.652960:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401088 00000100:00100000:2.0:1788330125.652964:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401088 00000100:00100000:2.0:1788330125.652997:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:2.0:1788330125.653007:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729401216:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330125.653088:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729401216:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 82us (1773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330125.653095:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:2.0:1788330125.653112:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:2.0:1788330125.653118:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2345:x1875199729401088:12345-192.168.202.47@tcp:9:kworker.0 00000020:00000080:2.0:1788330125.653136:0:6677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aab0e 00000100:00080000:2.0:1788330125.653145:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330125.653183:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967304 00000100:00100000:2.0:1788330125.653408:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+2:2345:x1875199729401088:12345-192.168.202.47@tcp:9:kworker.0 Request processed in 290us (1994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330125.653415:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 48 00010000:00010000:2.0:1788330125.653587:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330125.653722:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 152 00000100:00100000:0.0:1788330125.653736:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729400960:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330125.653789:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2347:x1875199729400960:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 57us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330125.656404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729400832 00000100:00100000:1.0:1788330125.656419:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729400832 00000100:00100000:1.0:1788330125.656499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 297 00000100:00100000:1.0:1788330125.656511:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729400832:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330125.656605:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729400832:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 96us (5406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330125.656613:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 297 00000100:00100000:2.0:1788330125.658163:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 153 00000100:00100000:2.0:1788330125.658182:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+6:2347:x1875199729401344:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330125.658244:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+6:2347:x1875199729401344:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 70us (6858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330125.658252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 153 00000100:00080000:2.0:1788330125.658301:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330125.658306:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330125.658309:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330125.663942:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 152 00000100:00100000:0.0:1788330125.887139:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330125.887226:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401600 00000100:00100000:2.0:1788330125.887254:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401600 00000100:00100000:2.0:1788330125.887324:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 137 00000100:00100000:2.0:1788330125.887338:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+13:11298:x1875199729401600:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330125.887371:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330125.887395:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab127 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed39 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887486:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887500:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887552:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887581:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887590:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887597:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887887:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab13c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887897:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab13c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.887904:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab13c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330125.887919:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788330125.888062:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888071:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888078:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888084:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330125.888088:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888096:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888108:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9546a5cd6200) 00010000:00010000:2.0:1788330125.888111:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330125.888115:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888122:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab12e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888134:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888140:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888155:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888160:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330125.888163:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888169:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888175:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff954692606900) 00010000:00010000:2.0:1788330125.888177:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330125.888180:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888185:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab135 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888574:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab127 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed39 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888589:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab13c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed39 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330125.888597:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:2.0:1788330125.888599:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330125.888601:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cde00, rc 0) 00000100:00100000:2.0:1788330125.888668:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+15:11298:x1875199729401600:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1334us (1542us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1788330125.888684:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 137 00000100:00100000:2.0:1788330125.904226:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330125.904278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330125.904370:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401728 00000100:00100000:0.0:1788330125.904370:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401856 00000100:00100000:3.0:1788330125.904380:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401728 00000100:00100000:0.0:1788330125.904380:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401856 00000100:00100000:3.0:1788330125.904440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:0.0:1788330125.904440:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 138 00000100:00100000:3.0:1788330125.904450:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+16:2347:x1875199729401728:12345-192.168.202.47@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788330125.904450:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+16:11298:x1875199729401856:12345-192.168.202.47@tcp:59:lhsmtool_posix.0 00010000:00010000:3.0:1788330125.904477:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330125.904503:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab13c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed39 expref: 16 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330125.904560:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330125.904566:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330125.904594:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+15:11298:x1875199729401856:12345-192.168.202.47@tcp:59:lhsmtool_posix.0 Request processed in 145us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330125.904602:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 138 00000100:00100000:3.0:1788330125.904803:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a372450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+14:2347:x1875199729401728:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 353us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330125.904811:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00010000:00010000:3.0:1788330126.050312:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330126.302695:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330126.302704:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330126.303329:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1788330126.303342:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330126.496646:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750381440:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.496717:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.496787:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788330126.496794:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750381056:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.496820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.496843:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750381568:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.496871:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.496898:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750381312:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.496938:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.496958:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788330126.496964:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750381184:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.496987:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.497004:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750381696:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.497025:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.497066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381568 00000100:00100000:1.0:1788330126.497074:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381568 00000100:00100000:1.0:1788330126.497122:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381312 00000100:00100000:1.0:1788330126.497126:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381312 00000100:00100000:1.0:1788330126.497141:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381184 00000100:00100000:1.0:1788330126.497144:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381184 00000100:00100000:1.0:1788330126.497158:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788330126.497166:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750381568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.497224:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750381568:12345-0@lo:400:kworker.0 Request processed in 58us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.497232:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788330126.497250:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788330126.497257:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750381312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.497287:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750381312:12345-0@lo:400:kworker.0 Request processed in 32us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.497293:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788330126.497305:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788330126.497311:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750381184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.497338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750381184:12345-0@lo:400:kworker.0 Request processed in 27us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.497354:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788330126.497395:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b588700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750381184:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.497407:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750381312:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.497434:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750381568:0@lo:400:kworker.0 00000100:00100000:2.0:1788330126.497788:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381440 00000100:00100000:2.0:1788330126.497794:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381440 00000100:00100000:2.0:1788330126.497836:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381696 00000100:00100000:2.0:1788330126.497840:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381696 00000100:00100000:2.0:1788330126.497865:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330126.497872:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750381440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330126.497918:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750381440:12345-0@lo:400:kworker.0 Request processed in 47us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330126.497925:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330126.497939:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788330126.497945:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750381696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330126.497979:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750381696:12345-0@lo:400:kworker.0 Request processed in 34us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330126.497985:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788330126.498007:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330126.498011:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330126.498013:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330126.498038:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750381696:0@lo:400:kworker.0 00000100:00100000:2.0:1788330126.498227:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750381440:0@lo:400:kworker.0 00000100:00100000:2.0:1788330126.498272:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381056 00000100:00100000:2.0:1788330126.498276:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381056 00000100:00100000:2.0:1788330126.498300:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788330126.498306:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750381056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330126.498339:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750381056:12345-0@lo:400:kworker.0 Request processed in 33us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330126.498344:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788330126.498379:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750381056:0@lo:400:kworker.0 00000100:00100000:1.0:1788330126.510066:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330126.510091:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750381824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330126.510161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330126.510215:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750381824 00000100:00100000:1.0:1788330126.510223:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750381824 00000100:00100000:1.0:1788330126.510275:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788330126.510284:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750381824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330126.510322:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330126.510369:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750381824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330126.510376:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788330126.510423:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750381824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788330127.076260:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788330127.109873:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:3.0:1788330128.098197:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330128.219443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330128.219486:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729401984 00000100:00100000:3.0:1788330128.219495:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729401984 00000100:00100000:3.0:1788330128.219562:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 139 00000100:00100000:3.0:1788330128.219570:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:11341:x1875199729401984:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330128.219587:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330128.219606:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed40 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219666:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219677:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219686:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219695:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219715:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219721:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219909:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219917:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219923:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219929:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330128.219934:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219941:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219954:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:3.0:1788330128.219957:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330128.219962:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219968:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab151 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219979:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219991:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.219996:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220001:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330128.220004:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220010:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220018:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff95468a2cc400) 00010000:00010000:3.0:1788330128.220021:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330128.220024:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220029:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab158 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220056:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab14a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed40 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220063:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:3.0:1788330128.220064:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330128.220066:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed40 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.220072:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9e00, rc 0) 00000100:00100000:3.0:1788330128.220122:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:11341:x1875199729401984:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 553us (698us total) trans 0 rc 301/301 00000100:00100000:3.0:1788330128.220128:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 139 00000100:00080000:3.0:1788330128.220145:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330128.226375:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330128.227128:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729402240 00000100:00100000:3.0:1788330128.227137:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729402240 00000100:00100000:3.0:1788330128.227186:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 140 00000100:00100000:3.0:1788330128.227194:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+13:11341:x1875199729402240:12345-192.168.202.47@tcp:36:lfs.0 00010000:00010000:3.0:1788330128.227240:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330128.227260:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9aaac8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb79 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.227273:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:3.0:1788330128.227276:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330128.227487:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.227502:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.227510:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.227559:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 5 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.227569:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 5 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330128.227589:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750381952:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330128.227671:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788330128.233064:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750381952:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330128.233095:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330128.234698:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.234803:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729402368 00000100:00100000:2.0:1788330128.234813:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729402368 00010000:00010000:2.0:1788330128.234876:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 6 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.234915:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:2.0:1788330128.234925:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729402368:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330128.234940:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330128.234947:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 6 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.234961:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 6 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235000:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab120 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed32 expref: 6 pid: 5846 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235015:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:2.0:1788330128.235021:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235031:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235038:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235064:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330128.235114:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729402368:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 190us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330128.235122:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 60 00010000:00010000:2.0:1788330128.235208:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235216:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235239:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235248:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.235256:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330128.236346:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788330128.236360:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.236369:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.236376:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.236382:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.236385:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.236393:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.236407:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95468a2cce00) 00010000:00010000:2.0:1788330128.236410:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.236415:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.236421:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab15f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330128.236440:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000aecdf9b0 reply state 000000007344c34a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.236449:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330128.236555:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+14:11341:x1875199729402240:12345-192.168.202.47@tcp:36:lfs.0 Request processed in 9359us (10186us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788330128.236568:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 140 00000100:00080000:3.0:1788330128.236844:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788330128.245662:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.245686:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.245695:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.245710:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330128.245716:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.245725:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.245895:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff954692606500) 00010000:00010000:1.0:1788330128.245900:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330128.245907:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.245914:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab166 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330128.342326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.342439:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729402496 00000100:00100000:0.0:1788330128.342450:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729402496 00000100:00100000:0.0:1788330128.342557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 141 00000100:00100000:0.0:1788330128.342569:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:11349:x1875199729402496:12345-192.168.202.47@tcp:101:lctl.0 00010000:00010000:0.0:1788330128.342597:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330128.342634:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab16d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed47 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.342709:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9ab174 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.342725:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9ab174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.342747:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9ab174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330128.342785:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788330128.342796:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330128.342822:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9ab174 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.342860:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab16d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed47 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.342880:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9ab174 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed47 expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.342889:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:0.0:1788330128.342893:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330128.342896:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfe00, rc 0) 00000100:00100000:0.0:1788330128.342957:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+14:11349:x1875199729402496:12345-192.168.202.47@tcp:101:lctl.0 Request processed in 390us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.342974:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 141 00000100:00100000:0.0:1788330128.425140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.425229:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729402624 00000100:00100000:2.0:1788330128.425239:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729402624 00000100:00100000:2.0:1788330128.425833:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 142 00000100:00100000:2.0:1788330128.425844:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:11355:x1875199729402624:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330128.425864:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.425886:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab17b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.425956:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.425971:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.425982:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.425998:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426005:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426013:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426120:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9ab190 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426147:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9ab190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426155:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9ab190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330128.426182:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788330128.426186:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330128.426205:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9ab190 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426217:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426224:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426232:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426238:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cd600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.426243:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426251:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426262:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:2.0:1788330128.426265:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.426271:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426286:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab182 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426301:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.426307:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.428230:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.428253:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cc800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.428259:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.428268:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.428284:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff954692606100) 00010000:00010000:2.0:1788330128.428287:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.428291:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.428298:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc800/0x91094de4de9ab189 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.429765:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab17b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed4e expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.429795:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9ab190 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed4e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.429822:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330128.429825:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788330128.429828:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20ccc00, rc 0) 00000100:00100000:2.0:1788330128.429904:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+15:11355:x1875199729402624:12345-192.168.202.47@tcp:101:bash.0 Request processed in 4060us (4773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330128.429914:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 142 00000100:00100000:0.0:1788330128.434456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330128.434592:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729402880 00000100:00100000:3.0:1788330128.434604:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729402880 00000100:00100000:3.0:1788330128.434694:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 143 00000100:00100000:3.0:1788330128.434705:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+15:11355:x1875199729402880:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330128.434726:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330128.434760:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab197 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed55 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.434905:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.434921:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.434932:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.436257:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.436271:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.436295:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330128.436990:0:10120:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788330128.437157:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437165:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437170:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437198:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437203:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437208:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437212:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.437215:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437227:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437239:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330128.437241:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.437243:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437248:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab19e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330128.437261:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b9205cb6 reply state 000000002228223c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.437268:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788330128.437304:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab197 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 18 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437317:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 17 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.437322:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:2.0:1788330128.437323:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330128.437325:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cdc00, rc 0) 00000100:00100000:2.0:1788330128.437409:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+18:11355:x1875199729402880:12345-192.168.202.47@tcp:101:bash.0 Request processed in 2704us (2973us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788330128.437417:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 143 00010000:00010000:2.0:1788330128.439423:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.439461:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.439468:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.439474:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.439479:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.439487:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.439507:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95468a2cc400) 00010000:00010000:2.0:1788330128.439511:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.439541:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.439548:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab1a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330128.445829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.446103:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729403008 00000100:00100000:2.0:1788330128.446114:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729403008 00000100:00100000:2.0:1788330128.446177:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:2.0:1788330128.446185:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875199729403008:12345-192.168.202.47@tcp:8:bash.0 00010000:00080000:2.0:1788330128.446217:0:6677:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp t0 exp 0000000000000000 cur 383 last 0 00000020:00000080:2.0:1788330128.446250:0:6677:0:(genops.c:1385:class_connect()) connect: client 7a815e47-382d-4064-91e8-23b9de97ce7e, cookie 0x91094de4de9ab1ba 00002000:00100000:2.0:1788330128.446262:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a815e47-382d-4064-91e8-23b9de97ce7e/ffff9546b78d5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788330128.446299:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788330128.446423:0:6677:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788330128.446468:0:6677:0:(import.c:65:import_set_state_nolock()) ffff9546b78d4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330128.446587:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2345:x1875199729403008:12345-192.168.202.47@tcp:8:bash.0 Request processed in 400us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330128.446597:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:0.0:1788330128.448942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.449023:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729403136 00000100:00100000:2.0:1788330128.449033:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729403136 00000100:00100000:2.0:1788330128.449115:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:2.0:1788330128.449127:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:0:x1875199729403136:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330128.449146:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.449177:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed5c expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330128.449206:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788330128.449226:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:2.0:1788330128.449231:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330128.449242:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.449261:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.449276:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd200, rc 0) 00000100:00100000:2.0:1788330128.449333:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:0:x1875199729403136:12345-192.168.202.47@tcp:101:bash.0 Request processed in 209us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330128.449357:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00080000:0.0:1788330128.449593:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330128.457886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.457974:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729403264 00000100:00100000:2.0:1788330128.457983:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729403264 00000100:00100000:2.0:1788330128.458047:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:2.0:1788330128.458058:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:11355:x1875199729403264:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330128.458081:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.458103:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed63 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.458134:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.458144:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330128.458148:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330128.458167:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.458206:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.458221:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.458235:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875199750382080:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330128.458361:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788330128.460725:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875199750382080:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330128.460776:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 8 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.460796:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cc800, rc 0) 00000100:00100000:3.0:1788330128.460860:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:11355:x1875199729403264:12345-192.168.202.47@tcp:101:bash.0 Request processed in 2803us (2986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330128.460869:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:3.0:1788330128.462925:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.463582:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729403392 00000100:00100000:2.0:1788330128.463592:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729403392 00010000:00010000:2.0:1788330128.463638:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.463684:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:2.0:1788330128.463695:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729403392:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330128.463721:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330128.463755:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.463770:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.463792:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bcb50989/0x91094de4de9ab1c1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed5c expref: 8 pid: 6676 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.463811:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330128.463815:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330128.463824:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.463834:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.463869:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.463897:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875199750382208:192.168.202.47@tcp:105: 00000100:00100000:2.0:1788330128.463986:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330128.472615:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5829:1875199750382208:192.168.202.47@tcp:105: 00010000:00010000:1.0:1788330128.472649:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330128.472724:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729403392:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 9030us (9807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330128.472745:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:0.0:1788330128.475492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330128.475684:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729403648 00000100:00100000:1.0:1788330128.475695:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729403648 00000100:00100000:1.0:1788330128.475986:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:1.0:1788330128.475998:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+17:11355:x1875199729403648:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:1.0:1788330128.476373:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+18:11355:x1875199729403648:12345-192.168.202.47@tcp:35:bash.0 Request processed in 376us (893us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788330128.476382:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:2.0:1788330128.542927:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750382336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330128.543007:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330128.543268:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750382336 00000100:00100000:1.0:1788330128.543279:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750382336 00000100:00100000:1.0:1788330128.543360:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788330128.543371:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750382336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330128.543400:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330128.543463:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750382336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330128.543470:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788330128.543628:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750382336:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788330128.544026:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330128.627449:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.627658:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729403904 00000100:00100000:2.0:1788330128.627667:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729403904 00000100:00100000:2.0:1788330128.627749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 144 00000100:00100000:2.0:1788330128.627761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+18:11365:x1875199729403904:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330128.627789:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.627812:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab1cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed6a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330128.627904:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788330128.628013:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab1cf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed6a expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.628026:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:2.0:1788330128.628028:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330128.628032:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab1cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed6a expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.628047:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd200, rc 0) 00000100:00100000:2.0:1788330128.628117:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11365:x1875199729403904:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 359us (676us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788330128.628123:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 144 00000100:00100000:3.0:1788330128.632461:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.632592:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729404160 00000100:00100000:2.0:1788330128.632603:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729404160 00000100:00100000:2.0:1788330128.632707:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:2.0:1788330128.632725:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11365:x1875199729404160:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:2.0:1788330128.632963:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11365:x1875199729404160:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 246us (509us total) trans 4294967420 rc 0/0 00000100:00100000:2.0:1788330128.632971:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:1.0:1788330128.687243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.687417:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729404288 00000100:00100000:0.0:1788330128.687426:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729404288 00000100:00100000:0.0:1788330128.687477:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 145 00000100:00100000:0.0:1788330128.687487:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11371:x1875199729404288:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330128.687512:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330128.687567:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab1dd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed71 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.687633:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab1e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.687647:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.687659:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330128.687689:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788330128.687692:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330128.687705:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab1e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.687729:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab1dd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed71 expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.687775:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab1e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed71 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.687784:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330128.687787:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330128.687790:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf800, rc 0) 00000100:00100000:0.0:1788330128.687842:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+21:11371:x1875199729404288:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 357us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.687846:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 145 00000100:00100000:3.0:1788330128.690333:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.690407:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729404544 00000100:00100000:2.0:1788330128.690417:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729404544 00000100:00100000:2.0:1788330128.690556:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 146 00000100:00100000:2.0:1788330128.690567:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+21:11371:x1875199729404544:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330128.690586:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.690607:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab1eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed78 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.690710:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab1f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.690724:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.690749:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab1f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330128.690761:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788330128.690888:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd200/0x91094de4de9ab1eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed78 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.690912:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab1f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed78 expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.690932:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:2.0:1788330128.690934:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330128.690938:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cd600, rc 0) 00000100:00100000:2.0:1788330128.690990:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+23:11371:x1875199729404544:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 425us (676us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788330128.690997:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 146 00000100:00100000:3.0:1788330128.693106:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.693294:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729404928 00000100:00100000:2.0:1788330128.693305:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729404928 00000100:00100000:3.0:1788330128.693696:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.693799:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729404672 00000100:00100000:0.0:1788330128.693816:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729404672 00000100:00100000:0.0:1788330128.693862:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:0.0:1788330128.693872:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:2346:x1875199729404672:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330128.693888:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330128.693923:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cd600/0x91094de4de9ab1f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed78 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.693942:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:0.0:1788330128.693947:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330128.694003:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+23:2346:x1875199729404672:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 132us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.694010:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:2.0:1788330128.694110:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 147 00000100:00100000:2.0:1788330128.694119:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+22:11371:x1875199729404928:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330128.694141:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.694156:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed7f expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.694242:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab207 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.694256:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.694267:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab207 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330128.694279:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788330128.694459:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cc600/0x91094de4de9ab200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed7f expref: 25 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.694486:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed7f expref: 24 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.694492:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:2.0:1788330128.694495:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330128.694497:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c20cde00, rc 0) 00000100:00100000:2.0:1788330128.694682:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11371:x1875199729404928:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 563us (1584us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788330128.694689:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 147 00000100:00100000:3.0:1788330128.698130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.698181:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729405056 00000100:00100000:2.0:1788330128.698192:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729405056 00000100:00100000:2.0:1788330128.698299:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:2.0:1788330128.698311:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729405056:12345-192.168.202.47@tcp:1:lfs.0 00010000:00010000:2.0:1788330128.698367:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.698386:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.698394:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330128.698399:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330128.698404:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.698441:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.698469:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 7 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.698485:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875199750382464:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330128.698600:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330128.700403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.700421:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875199750382464:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330128.700446:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330128.700498:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729405184 00000100:00100000:0.0:1788330128.700505:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729405184 00002000:00100000:0.0:1788330128.700599:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9546beff9880 x1875199729405184/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:144/0 lens 504/0 e 0 to 0 dl 1788330139 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788330128.700609:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546beff9880 with x1875199729405184 ext(0->12) 00010000:00010000:0.0:1788330128.700616:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 8 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.700631:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 8 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330128.700638:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9546beff9880 00000100:00100000:0.0:1788330128.700661:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:0.0:1788330128.700670:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729405184:12345-192.168.202.47@tcp:4:lfs.0 00000001:00100000:2.0:1788330128.723075:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000001:00100000:2.0:1788330128.723087:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:2.0:1788330128.723091:0:6702:0:(genops.c:885:class_export_put()) final put ffff9546a1ee2000/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:3.0:1788330128.723114:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a1ee2000/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-OST0000 00000020:00000080:3.0:1788330128.723175:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546a1ee7800 for lustre-OST0000 00000100:00100000:1.0:1788330128.723493:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2347:x1875199729405184:12345-192.168.202.47@tcp:4:lfs.0 Request processed in 22818us (23092us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788330128.723506:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00002000:00100000:1.0:1788330128.723543:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9546beff9880 x1875199729405184/t4294967305(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:144/0 lens 504/448 e 0 to 0 dl 1788330139 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788330128.723553:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546beff9880 with x1875199729405184 ext(0->12) 00010000:00010000:1.0:1788330128.723563:0:6684:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 9 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.723580:0:6684:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 9 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330128.723588:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9546beff9880 00000100:00100000:3.0:1788330128.726086:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.726243:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729405312 00000100:00100000:0.0:1788330128.726252:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729405312 00010000:00010000:0.0:1788330128.726285:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 9 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330128.726362:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 62 00000100:00100000:0.0:1788330128.726373:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2349:x1875199729405312:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330128.726389:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788330128.726410:0:5830:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788330128.726414:0:5830:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788330128 00002000:00010000:0.0:1788330128.726417:0:5830:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788330129 00002000:00010000:0.0:1788330128.726419:0:5830:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788330128 00010000:00010000:0.0:1788330128.726425:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 9 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.726440:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 9 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.726462:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ff665bb/0x91094de4de9ab1c8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed63 expref: 9 pid: 6677 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.726479:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330128.726484:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330128.726490:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.726553:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.726582:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330128.726628:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2349:x1875199729405312:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 257us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.726635:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 62 00010000:00010000:2.0:1788330128.726721:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726728:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726758:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726770:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726790:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726797:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ec00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330128.726801:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726809:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726820:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.726826:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5bc5b1a/0x91094de4de9ab215 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.726871:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beffad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729405056:12345-192.168.202.47@tcp:1:lfs.0 Request processed in 28562us (28751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330128.726878:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:3.0:1788330128.728443:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330128.728548:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729405568 00000100:00100000:1.0:1788330128.728559:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729405568 00000100:00100000:1.0:1788330128.728645:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00100000:1.0:1788330128.728662:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11371:x1875199729405568:12345-192.168.202.47@tcp:35:lfs.0 00000004:00010000:1.0:1788330128.728750:0:5848:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab207 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed7f expref: 24 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788330128.729107:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788330128.729140:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788330128.730493:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788330128.730604:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.730622:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 28 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.730630:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.730667:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 28 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330128.730682:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 28 pid: 10120 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330128.730696:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875199750382592:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330128.730784:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a206540 going to sleep for 11 seconds 00000100:00100000:1.0:1788330128.733014:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5848:1875199750382592:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330128.733045:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330128.733837:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.733996:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729405696 00000100:00100000:0.0:1788330128.734003:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729405696 00010000:00010000:0.0:1788330128.734039:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 29 pid: 10120 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330128.734071:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 63 00000100:00100000:0.0:1788330128.734079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+29:2347:x1875199729405696:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330128.734093:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330128.734098:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 29 pid: 10120 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.734109:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 29 pid: 10120 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.734128:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cdc00/0x91094de4de9ab1ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed55 expref: 29 pid: 10120 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.734144:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:0.0:1788330128.734163:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.734173:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.734181:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.734211:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330128.734261:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+28:2347:x1875199729405696:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 182us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.734268:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 63 00010000:00010000:3.0:1788330128.734343:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.734351:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330128.734472:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1788330128.734695:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1788330128.734807:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750382720:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788330128.734851:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330128.734886:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330128.734941:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750382720 00000100:00100000:1.0:1788330128.734954:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750382720 00000100:00100000:1.0:1788330128.734992:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330128.735000:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875199750382720:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330128.735084:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875199750382720:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 84us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330128.735091:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330128.735239:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750382720:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788330128.736602:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788330128.736697:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750382848:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788330128.737016:0:5848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330128.737092:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330128.737225:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750382848 00000100:00100000:1.0:1788330128.737233:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750382848 00000100:00100000:1.0:1788330128.737311:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330128.737321:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5848:x1875199750382848:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788330128.737605:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5848:x1875199750382848:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 285us (589us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788330128.737613:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330128.738038:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5848:1875199750382848:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788330128.738105:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788330128.738145:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.738156:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.738164:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.738169:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330128.738184:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.738192:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.738208:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:3.0:1788330128.738211:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788330128.738215:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330128.738221:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab21c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330128.738640:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788330128.738821:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1788330128.738833:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 383651314359ns, next at 384651312188ns, rc = 0 00000001:00080000:3.0:1788330128.738839:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788330128.738872:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954692606300) 00010000:00010000:3.0:1788330128.738876:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788330128.738883:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cde00/0x91094de4de9ab207 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed7f expref: 32 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330128.739024:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d55850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+31:11371:x1875199729405568:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 10369us (10589us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788330128.739033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 38 00000020:00080000:3.0:1788330128.739038:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788330128.746472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.746675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729405824 00000100:00100000:0.0:1788330128.746685:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729405824 00000100:00100000:0.0:1788330128.746877:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 148 00000100:00100000:0.0:1788330128.746890:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+31:11371:x1875199729405824:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330128.746918:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330128.746940:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed86 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.746995:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed86 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.747007:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab223 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed86 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.747021:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330128.747024:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330128.747039:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfc00, rc 0) 00000100:00100000:0.0:1788330128.747120:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11371:x1875199729405824:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 234us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.747727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 148 00000100:00100000:2.0:1788330128.750043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.750111:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729406080 00000100:00100000:0.0:1788330128.750120:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729406080 00000100:00100000:0.0:1788330128.750199:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:0.0:1788330128.750210:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11371:x1875199729406080:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330128.750553:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+33:11371:x1875199729406080:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 344us (516us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788330128.750558:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:1.0:1788330128.821271:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.821414:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729406336 00000100:00100000:0.0:1788330128.821515:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729406336 00000100:00100000:0.0:1788330128.821635:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 149 00000100:00100000:0.0:1788330128.821646:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+33:11381:x1875199729406336:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330128.821673:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330128.821694:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab22a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed8d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330128.821830:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788330128.822230:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab22a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed8d expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.822244:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:0.0:1788330128.822246:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330128.822249:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab22a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed8d expref: 35 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.822275:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacec00, rc 0) 00000100:00100000:0.0:1788330128.822840:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11381:x1875199729406336:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1193us (1575us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788330128.822853:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 149 00000100:00100000:1.0:1788330128.826724:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.826789:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729406464 00000100:00100000:2.0:1788330128.826800:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729406464 00000100:00100000:2.0:1788330128.826857:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 150 00000100:00100000:2.0:1788330128.826867:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11381:x1875199729406464:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:2.0:1788330128.826944:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.826973:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.826986:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827001:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827009:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827015:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827112:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827120:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827128:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330128.827232:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827244:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827249:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827261:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827265:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.827268:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827273:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827282:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330128.827283:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.827286:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827290:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab238 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827300:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827303:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827307:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827310:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.827311:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827331:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827339:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606100) 00010000:00010000:2.0:1788330128.827341:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.827344:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827350:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab23f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827365:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827371:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827376:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827380:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.827381:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827385:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827389:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330128.827390:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.827392:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.827402:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab246 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330128.827551:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11381:x1875199729406464:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 683us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330128.827559:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 150 00000100:00100000:2.0:1788330128.830568:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330128.831020:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729406720 00000100:00100000:3.0:1788330128.831029:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729406720 00000100:00100000:3.0:1788330128.831118:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330128.831127:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11381:x1875199729406720:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330128.831372:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+35:11381:x1875199729406720:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 245us (814us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788330128.831380:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:1.0:1788330128.858879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330128.858948:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729406976 00000100:00100000:2.0:1788330128.858959:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729406976 00000100:00100000:2.0:1788330128.859069:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 151 00000100:00100000:2.0:1788330128.859080:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+35:11384:x1875199729406976:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330128.859104:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330128.859124:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab24d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed94 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859193:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859207:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859218:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859232:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859239:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859263:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859380:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859389:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859396:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330128.859404:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788330128.859505:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859512:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859541:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859546:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.859549:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859554:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859563:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330128.859565:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.859572:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859576:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859587:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859594:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859599:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859604:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330128.859606:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859611:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859618:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606100) 00010000:00010000:2.0:1788330128.859621:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330128.859623:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859629:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab25b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859665:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab24d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 38 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859683:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 37 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330128.859688:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330128.859690:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330128.859692:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ec00, rc 0) 00000100:00100000:2.0:1788330128.859767:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11384:x1875199729406976:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 688us (898us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788330128.859773:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 151 00000100:00100000:1.0:1788330128.861976:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.862033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729407104 00000100:00100000:0.0:1788330128.862041:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729407104 00000100:00100000:0.0:1788330128.862108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 152 00000100:00100000:0.0:1788330128.862116:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11384:x1875199729407104:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:0.0:1788330128.862170:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862185:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862196:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862220:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862224:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862229:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862232:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacec00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330128.862235:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862249:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862258:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330128.862260:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330128.862262:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330128.862266:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab270 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330128.862317:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11384:x1875199729407104:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 201us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330128.862325:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 152 00000100:00100000:3.0:1788330128.864123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330128.864189:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729407360 00000100:00100000:0.0:1788330128.864198:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729407360 00000100:00100000:0.0:1788330128.864242:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:0.0:1788330128.864249:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11384:x1875199729407360:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330128.864446:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+38:11384:x1875199729407360:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 197us (328us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788330128.864454:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:1.0:1788330129.090363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.090490:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729407616 00000100:00100000:0.0:1788330129.090503:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729407616 00000100:00100000:0.0:1788330129.090665:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 153 00000100:00100000:0.0:1788330129.090677:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+38:11414:x1875199729407616:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:0.0:1788330129.090705:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330129.090748:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ed9b expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.090956:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab27e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.090969:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.090979:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330129.090987:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788330129.091252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed9b expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.091268:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed9b expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.091275:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330129.091277:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330129.091280:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330129.091352:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11414:x1875199729407616:12345-192.168.202.47@tcp:101:cat.0 Request processed in 677us (1001us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788330129.091359:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 153 00000100:00100000:1.0:1788330129.094440:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.094647:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729407872 00000100:00100000:0.0:1788330129.094659:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729407872 00000100:00100000:0.0:1788330129.094919:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:0.0:1788330129.094931:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11414:x1875199729407872:12345-192.168.202.47@tcp:35:cat.0 00000100:00100000:0.0:1788330129.095354:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+41:11414:x1875199729407872:12345-192.168.202.47@tcp:35:cat.0 Request processed in 425us (932us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788330129.095377:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:1.0:1788330129.097456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.097608:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729408000 00000100:00100000:2.0:1788330129.097618:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729408000 00000100:00100000:2.0:1788330129.097689:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:2.0:1788330129.097699:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+41:2346:x1875199729408000:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330129.097726:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330129.097764:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab27e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed9b expref: 41 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.097783:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330129.097788:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330129.097852:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+40:2346:x1875199729408000:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 154us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330129.097859:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00010000:00010000:0.0:1788330129.143069:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330129.159274:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.159560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729408256 00000100:00100000:2.0:1788330129.159574:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729408256 00000100:00100000:2.0:1788330129.159663:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 154 00000100:00100000:2.0:1788330129.159689:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11421:x1875199729408256:12345-192.168.202.47@tcp:101:dd.0 00010000:00010000:2.0:1788330129.159718:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330129.159722:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788330129.159760:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab1e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed71 expref: 40 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.159780:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330129.159785:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330129.159800:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab28c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eda2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.159923:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.159938:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 40 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.159946:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.159977:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 40 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.159991:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 40 pid: 10120 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330129.160005:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750382976:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330129.160106:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330129.166386:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750382976:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330129.166421:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.168417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.168714:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729408384 00000100:00100000:0.0:1788330129.168727:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729408384 00010000:00010000:0.0:1788330129.168790:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 41 pid: 10120 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330129.168831:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:0.0:1788330129.168842:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+41:2349:x1875199729408384:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330129.168859:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330129.168867:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 41 pid: 10120 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.168882:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 41 pid: 10120 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.168909:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed94 expref: 41 pid: 10120 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.168927:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330129.168932:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.168942:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.168950:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.168999:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330129.169063:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a371c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+40:2349:x1875199729408384:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 222us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330129.169071:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 64 00010000:00010000:2.0:1788330129.170980:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.170996:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330129.171021:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788330129.171285:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab28c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.171307:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.171438:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330129.171441:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330129.171446:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ea00, rc 0) 00000100:00100000:2.0:1788330129.171715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11421:x1875199729408256:12345-192.168.202.47@tcp:101:dd.0 Request processed in 12026us (12452us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788330129.171724:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 154 00000100:00100000:1.0:1788330129.176648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.176852:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729408640 00000100:00100000:2.0:1788330129.176864:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729408640 00000100:00100000:2.0:1788330129.176928:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 155 00000100:00100000:2.0:1788330129.176939:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11421:x1875199729408640:12345-192.168.202.47@tcp:36:dd.0 00010000:00010000:2.0:1788330129.177947:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.177986:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.178000:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330129.178071:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788330129.178100:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000078f09653 reply state 00000000fe3ef226 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330129.178109:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330129.179988:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+43:11421:x1875199729408640:12345-192.168.202.47@tcp:36:dd.0 Request processed in 3035us (3337us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788330129.180001:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 155 00000020:00080000:2.0:1788330129.180008:0:10120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788330129.184282:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.184301:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.184828:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.184835:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330129.184840:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.184847:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.184863:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:1.0:1788330129.184865:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330129.184868:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.184873:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.558069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.558199:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729408768 00000100:00100000:0.0:1788330129.558211:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729408768 00000100:00100000:0.0:1788330129.558285:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 156 00000100:00100000:0.0:1788330129.558297:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+42:11435:x1875199729408768:12345-192.168.202.47@tcp:101:stat.0 00010000:00010000:0.0:1788330129.558328:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330129.558352:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eda9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558624:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558641:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558654:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558671:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558679:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558685:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558821:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558833:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558841:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558877:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.558891:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 43 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330129.558905:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750383104:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330129.559056:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330129.561722:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330129.561981:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729409024 00000100:00100000:3.0:1788330129.561990:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729409024 00000100:00100000:3.0:1788330129.562040:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:3.0:1788330129.562047:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+44:5588:x1875199729409024:12345-192.168.202.47@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788330129.562343:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:5588:x1875199729409024:12345-192.168.202.47@tcp:35:ldlm_bl.0 Request processed in 295us (641us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788330129.562349:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:0.0:1788330129.562875:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750383104:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330129.562901:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.564220:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330129.564296:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729409152 00000100:00100000:3.0:1788330129.564303:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729409152 00010000:00010000:3.0:1788330129.564344:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 45 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330129.564374:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:3.0:1788330129.564380:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+45:2346:x1875199729409152:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330129.564392:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330129.564397:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 45 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.564413:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 45 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.564467:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab293 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda2 expref: 45 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.564482:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:3.0:1788330129.564486:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.564493:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.564498:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.564555:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330129.564555:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564567:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330129.564598:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+44:2346:x1875199729409152:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 216us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330129.564605:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 65 00000004:00200000:0.0:1788330129.564793:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788330129.564804:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330129.564830:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564845:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564856:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564862:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564869:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564876:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330129.564880:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564887:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564896:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330129.564899:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330129.564902:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.564986:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565000:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565016:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565022:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565027:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330129.565031:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565037:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565061:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330129.565064:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330129.565067:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565073:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565124:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda9 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565141:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda9 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.565149:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330129.565151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330129.565160:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf400, rc 0) 00000100:00100000:0.0:1788330129.565204:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+43:11435:x1875199729408768:12345-192.168.202.47@tcp:101:stat.0 Request processed in 6909us (7150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330129.565211:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 156 00000100:00100000:1.0:1788330129.628204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.628336:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729409408 00000100:00100000:0.0:1788330129.628348:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729409408 00000100:00100000:0.0:1788330129.628640:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 157 00000100:00100000:0.0:1788330129.628653:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+43:11441:x1875199729409408:12345-192.168.202.47@tcp:36:truncate.0 00010000:00010000:0.0:1788330129.628723:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330129.628765:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab2bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eda9 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.628788:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330129.628794:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330129.629013:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.629029:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.629040:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330129.629365:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788330129.629393:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000bc19caf2 reply state 000000006f335809 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330129.630210:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330129.630346:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+45:11441:x1875199729409408:12345-192.168.202.47@tcp:36:truncate.0 Request processed in 1694us (2152us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788330129.630375:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 157 00000020:00080000:0.0:1788330129.630381:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788330129.633962:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.633981:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.633998:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.634005:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacec00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330129.634011:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.634018:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.634055:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330129.634058:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330129.634064:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.634070:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab2c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.804761:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.804851:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729409536 00000100:00100000:2.0:1788330129.804864:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729409536 00000100:00100000:2.0:1788330129.804926:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 158 00000100:00100000:2.0:1788330129.804938:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+44:11455:x1875199729409536:12345-192.168.202.47@tcp:101:stat.0 00010000:00010000:2.0:1788330129.804966:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330129.804999:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab2cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edb0 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805076:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805092:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805104:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805118:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805124:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805149:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805251:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805259:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805266:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330129.805304:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788330129.805308:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330129.805330:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805343:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805352:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805358:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805365:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805370:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ea00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330129.805374:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805388:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805401:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330129.805404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330129.805408:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805414:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab2d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805428:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805435:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805440:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805445:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330129.805448:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805454:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805461:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606100) 00010000:00010000:2.0:1788330129.805463:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330129.805466:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805483:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab2d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805569:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab2cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 46 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805599:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.805606:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330129.805609:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330129.805612:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ec00, rc 0) 00000100:00100000:2.0:1788330129.805685:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+45:11455:x1875199729409536:12345-192.168.202.47@tcp:101:stat.0 Request processed in 749us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330129.805693:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 158 00000100:00100000:3.0:1788330129.880200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.880658:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729409792 00000100:00100000:2.0:1788330129.880670:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729409792 00000100:00100000:2.0:1788330129.880747:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 159 00000100:00100000:2.0:1788330129.880759:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+45:11465:x1875199729409792:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330129.880782:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330129.880805:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab2e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edb7 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330129.880927:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788330129.881094:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab2e7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb7 expref: 47 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.881137:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:2.0:1788330129.881140:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330129.881145:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab2e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb7 expref: 47 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.881162:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214f400, rc 0) 00000100:00100000:2.0:1788330129.881237:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+46:11465:x1875199729409792:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 479us (1049us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788330129.881245:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 159 00000100:00100000:3.0:1788330129.886691:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330129.886776:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729410048 00000100:00100000:1.0:1788330129.886790:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729410048 00000100:00100000:1.0:1788330129.886848:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:1.0:1788330129.886859:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+46:11465:x1875199729410048:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:1.0:1788330129.887123:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d56c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+47:11465:x1875199729410048:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 265us (444us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1788330129.887149:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:1.0:1788330129.967169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.967474:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729410304 00000100:00100000:0.0:1788330129.967487:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729410304 00000100:00100000:0.0:1788330129.967589:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 160 00000100:00100000:0.0:1788330129.967602:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+47:11471:x1875199729410304:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330129.967633:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330129.967656:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edbe expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.967782:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.967799:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.967808:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.967842:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 48 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.968080:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 48 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330129.968094:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750383232:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330129.968250:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330129.973612:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.973765:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750383232:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330129.973791:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.973988:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729410432 00000100:00100000:1.0:1788330129.973996:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729410432 00010000:00010000:1.0:1788330129.974040:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 49 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.974084:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:1.0:1788330129.974095:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+49:2347:x1875199729410432:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330129.974109:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330129.974116:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 49 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.974129:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 49 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.974149:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab2e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edb0 expref: 49 pid: 5846 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.974166:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:1.0:1788330129.974170:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.974180:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.974188:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330129.974220:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330129.974301:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.974309:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330129.974343:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788330129.974494:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab2f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.974509:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.974557:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330129.974567:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330129.974570:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface800, rc 0) 00000100:00100000:1.0:1788330129.975838:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+49:2347:x1875199729410432:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 1739us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330129.975859:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:2.0:1788330129.975934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+48:11471:x1875199729410304:12345-192.168.202.47@tcp:101:bash.0 Request processed in 8334us (8778us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788330129.975941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 160 00000100:00100000:3.0:1788330129.978966:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.979099:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729410688 00000100:00100000:2.0:1788330129.979110:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729410688 00000100:00100000:2.0:1788330129.979163:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 161 00000100:00100000:2.0:1788330129.979173:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+48:11471:x1875199729410688:12345-192.168.202.47@tcp:36:bash.0 00010000:00010000:2.0:1788330129.979471:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.979488:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.979500:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330129.979816:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788330129.979843:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d9842996 reply state 00000000dcce2da5 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330129.979853:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330129.979941:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+51:11471:x1875199729410688:12345-192.168.202.47@tcp:36:bash.0 Request processed in 768us (992us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788330129.979959:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 161 00000020:00080000:2.0:1788330129.979964:0:10120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788330129.987942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330129.988577:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729410816 00000100:00100000:2.0:1788330129.988588:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729410816 00000100:00100000:2.0:1788330129.988644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 162 00000100:00100000:2.0:1788330129.988670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+51:11471:x1875199729410816:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330129.988697:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330129.988718:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab311 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edc5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988812:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988828:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988837:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988854:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988872:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988898:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.988911:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 52 pid: 5844 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330129.988925:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750383360:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330129.989298:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a840 going to sleep for 11 seconds 00010000:00010000:3.0:1788330129.990275:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990288:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990294:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990482:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330129.990488:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990496:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990514:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:3.0:1788330129.990589:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330129.990592:0:3299:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990602:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330129.990609:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab30a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330129.994648:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330129.995093:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729410944 00000100:00100000:0.0:1788330129.995104:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729410944 00010000:00010000:0.0:1788330129.995151:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 52 pid: 5844 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330129.995190:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 67 00000100:00100000:0.0:1788330129.995200:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:2346:x1875199729410944:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330129.995214:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330129.995221:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 52 pid: 5844 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.995235:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 52 pid: 5844 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.995259:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330129.995265:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.995275:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.995283:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330129.995301:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330129.995377:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:2346:x1875199729410944:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 177us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330129.995385:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 67 00010000:00010000:2.0:1788330129.995807:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab2fc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edbe expref: 51 pid: 5844 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330129.995832:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750383360:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330129.995862:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.995871:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.995877:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330129.995922:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788330129.995926:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330129.995945:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.995986:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab311 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edc5 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.996002:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edc5 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330129.996008:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330129.996011:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330129.996014:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ea00, rc 0) 00000100:00100000:2.0:1788330129.996042:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+50:11471:x1875199729410816:12345-192.168.202.47@tcp:101:bash.0 Request processed in 7375us (8130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330129.996048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 162 00000100:00100000:0.0:1788330130.002063:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.002157:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729411200 00000100:00100000:2.0:1788330130.002168:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729411200 00000100:00100000:2.0:1788330130.002277:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:2.0:1788330130.002288:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+50:11471:x1875199729411200:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:2.0:1788330130.002927:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+51:11471:x1875199729411200:12345-192.168.202.47@tcp:35:bash.0 Request processed in 637us (870us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788330130.002937:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00080000:0.0:1788330130.011394:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330130.117821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.117923:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729411456 00000100:00100000:2.0:1788330130.117932:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729411456 00000100:00100000:2.0:1788330130.117993:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 163 00000100:00100000:2.0:1788330130.118004:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+51:11481:x1875199729411456:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330130.118026:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330130.118047:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab31f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edcc expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330130.118139:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788330130.118248:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab31f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edcc expref: 53 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.118264:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:2.0:1788330130.118267:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330130.118273:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab31f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edcc expref: 53 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.118291:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fe00, rc 0) 00000100:00100000:2.0:1788330130.118373:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11481:x1875199729411456:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 371us (562us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788330130.118399:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 163 00000100:00100000:1.0:1788330130.123271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330130.123622:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729411584 00000100:00100000:0.0:1788330130.123633:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729411584 00000100:00100000:0.0:1788330130.123692:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 164 00000100:00100000:0.0:1788330130.123703:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11481:x1875199729411584:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:0.0:1788330130.123886:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.123904:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.123919:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.123937:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.123945:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.123951:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124046:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124055:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124063:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330130.124124:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124137:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124144:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124151:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124156:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330130.124161:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124168:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124181:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330130.124184:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330130.124188:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124195:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab32d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124207:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124214:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124225:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124230:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330130.124234:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124240:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124248:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9546a5cd6d00) 00010000:00010000:0.0:1788330130.124250:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330130.124253:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124260:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124273:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124279:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124285:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124289:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacec00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330130.124292:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124306:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124710:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330130.124714:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330130.124728:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.124735:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab33b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330130.124822:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11481:x1875199729411584:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 1119us (1562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330130.124830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 164 00000100:00100000:0.0:1788330130.128702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330130.128806:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729411840 00000100:00100000:1.0:1788330130.128815:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729411840 00000100:00100000:1.0:1788330130.128971:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:1.0:1788330130.128982:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11481:x1875199729411840:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:1.0:1788330130.129204:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+53:11481:x1875199729411840:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 224us (511us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1788330130.129212:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:1.0:1788330130.169397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.169692:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729412096 00000100:00100000:2.0:1788330130.169703:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729412096 00000100:00100000:2.0:1788330130.169780:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 165 00000100:00100000:2.0:1788330130.169792:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+53:11484:x1875199729412096:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330130.169818:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330130.169840:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab342 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edd3 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170011:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170026:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170039:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170052:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170059:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170065:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170186:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab357 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170205:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170212:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab357 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330130.170222:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788330130.170785:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170793:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170800:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170806:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330130.170810:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170818:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.170832:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330130.170835:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330130.170839:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171173:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9ab349 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171189:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171204:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171209:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171215:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214ec00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330130.171218:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171224:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171233:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606100) 00010000:00010000:2.0:1788330130.171236:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330130.171239:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171245:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9ab350 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171294:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9ab342 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edd3 expref: 56 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171308:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab357 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edd3 expref: 55 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.171414:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330130.171662:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330130.171675:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dbc00, rc 0) 00000100:00100000:2.0:1788330130.171757:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11484:x1875199729412096:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1966us (2372us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788330130.171766:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 165 00000100:00100000:3.0:1788330130.179828:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330130.179947:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.180061:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729412352 00000100:00100000:2.0:1788330130.180075:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729412352 00000100:00100000:2.0:1788330130.180156:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:2.0:1788330130.180168:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+55:2347:x1875199729412352:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330130.180187:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330130.180217:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab357 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edd3 expref: 55 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.180243:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330130.180251:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330130.180348:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+54:2347:x1875199729412352:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 181us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330130.180357:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:0.0:1788330130.180671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729412224 00000100:00100000:0.0:1788330130.180675:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729412224 00000100:00100000:0.0:1788330130.180713:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 166 00000100:00100000:0.0:1788330130.180732:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11484:x1875199729412224:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:0.0:1788330130.180816:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180832:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180852:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180888:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180915:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180922:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180928:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330130.180933:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180941:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180950:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330130.180953:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330130.180957:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.180962:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330130.181004:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11484:x1875199729412224:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 284us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330130.181010:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 166 00000100:00100000:0.0:1788330130.184183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.184247:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729412608 00000100:00100000:2.0:1788330130.184258:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729412608 00000100:00100000:2.0:1788330130.184412:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 47 00000100:00100000:2.0:1788330130.184434:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11484:x1875199729412608:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:2.0:1788330130.184735:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11484:x1875199729412608:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 291us (547us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788330130.188768:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 47 00010000:00010000:3.0:1788330130.208186:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330130.327175:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330130.337330:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729412864 00000100:00100000:0.0:1788330130.337347:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729412864 00000100:00100000:0.0:1788330130.337765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 167 00000100:00100000:0.0:1788330130.337787:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11502:x1875199729412864:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:0.0:1788330130.337831:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330130.337855:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab36c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edda expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.337953:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab373 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.337968:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.337981:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330130.337992:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788330130.338152:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edda expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.338172:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab373 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edda expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.338180:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330130.338183:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788330130.338187:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface200, rc 0) 00000100:00100000:0.0:1788330130.338266:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11502:x1875199729412864:12345-192.168.202.47@tcp:101:cat.0 Request processed in 490us (11101us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1788330130.338273:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 167 00000100:00100000:3.0:1788330130.387204:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330130.389972:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729412992 00000100:00100000:0.0:1788330130.389988:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729412992 00000100:00100000:3.0:1788330130.390996:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 168 00000100:00100000:3.0:1788330130.391015:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11503:x1875199729412992:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330130.391047:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330130.391080:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab381 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ede1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330130.391185:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330130.391199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330130.391210:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330130.391247:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788330130.391251:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330130.391269:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330130.391294:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab381 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede1 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330130.391316:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede1 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330130.391325:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330130.391327:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330130.391331:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9a00, rc 0) 00000100:00100000:3.0:1788330130.391405:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11503:x1875199729412992:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 397us (4344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330130.391413:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 168 00000100:00100000:3.0:1788330130.412972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330130.413378:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729413376 00000100:00100000:1.0:1788330130.413391:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729413376 00000100:00100000:1.0:1788330130.413468:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:1.0:1788330130.413480:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11503:x1875199729413376:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:1.0:1788330130.414032:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11503:x1875199729413376:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 552us (1069us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788330130.414041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:1.0:1788330130.426390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330130.431321:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729413504 00000100:00100000:0.0:1788330130.431359:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729413504 00000100:00100000:0.0:1788330130.431459:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:0.0:1788330130.431471:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11503:x1875199729413504:12345-192.168.202.47@tcp:103:lfs.0 00010000:00010000:0.0:1788330130.431488:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788330130.431516:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9ab318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edc5 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.431559:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edda expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.431587:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed86 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.431598:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330130.431616:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330130.431679:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+56:11503:x1875199729413504:12345-192.168.202.47@tcp:103:lfs.0 Request processed in 210us (5299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330130.431686:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788330130.435256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.435492:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729413632 00000100:00100000:2.0:1788330130.435502:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729413632 00000100:00100000:0.0:1788330130.435767:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 169 00000100:00100000:0.0:1788330130.435794:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+56:11503:x1875199729413632:12345-192.168.202.47@tcp:58:lfs.0 00010000:00010000:0.0:1788330130.435951:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.435970:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330130.435982:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330130.436218:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788330130.436299:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+56:11503:x1875199729413632:12345-192.168.202.47@tcp:58:lfs.0 Request processed in 520us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330130.436308:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 169 00000100:00100000:1.0:1788330130.462835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.463008:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729413760 00000100:00100000:2.0:1788330130.463034:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729413760 00000100:00100000:2.0:1788330130.463098:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 170 00000100:00100000:2.0:1788330130.463109:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+56:11505:x1875199729413760:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330130.463141:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330130.463164:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ede8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463244:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463262:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463274:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463289:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463296:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463303:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463407:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463417:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463424:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330130.463466:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788330130.463470:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330130.463488:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463501:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463509:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463515:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463562:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463569:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dbe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330130.463573:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463581:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463595:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330130.463598:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330130.463603:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463610:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab39d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463635:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463641:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463648:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463653:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330130.463656:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463662:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463671:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606100) 00010000:00010000:2.0:1788330130.463673:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330130.463676:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463682:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab3a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463714:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463742:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330130.463761:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:2.0:1788330130.463763:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330130.463891:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da600, rc 0) 00000100:00100000:2.0:1788330130.464070:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11505:x1875199729413760:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 962us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330130.464078:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 170 00000100:00100000:1.0:1788330130.754435:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330130.754657:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330130.754690:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330130.754788:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729413888 00000100:00100000:2.0:1788330130.754799:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729413888 00000100:00100000:2.0:1788330130.754850:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 299 00000100:00100000:2.0:1788330130.754861:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729413888:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330130.754939:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729413888:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 79us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330130.754947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 299 00000100:00100000:1.0:1788330130.755383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330130.755408:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414272 00000100:00100000:1.0:1788330130.755423:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414272 00000100:00100000:1.0:1788330130.755471:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 157 00000100:00100000:1.0:1788330130.755479:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729414272:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330130.755541:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729414272:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 40us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330130.755549:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 157 00000100:00080000:1.0:1788330130.755590:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330130.756854:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414016 00000100:00100000:3.0:1788330130.756863:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414016 00000100:00080000:1.0:1788330130.756944:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330130.757073:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414144 00000100:00100000:0.0:1788330130.757079:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414144 00000100:00100000:1.0:1788330130.757577:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 82 00000100:00100000:2.0:1788330130.757610:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 83 00000100:00100000:2.0:1788330130.757623:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729414144:12345-192.168.202.47@tcp:400:kworker.0 00000100:00080000:0.0:1788330130.757706:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330130.757842:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729414016:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330130.757847:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729414144:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 225us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330130.757858:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 83 00000100:00100000:1.0:1788330130.757877:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729414016:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 290us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330130.757886:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 82 00010000:00010000:0.0:1788330131.237795:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330131.262256:0:12506:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330131.262271:0:12506:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330131.262340:0:12506:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788330131.262350:0:12506:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788330131.426440:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330131.426455:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330131.426511:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788330131.427023:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330131.427208:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b588700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750383488:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330131.427343:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0d15a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330131.438763:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b588700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750383488:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330131.442902:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.443185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414400 00000100:00100000:2.0:1788330131.443200:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414400 00000100:00100000:2.0:1788330131.443288:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 171 00000100:00100000:2.0:1788330131.443302:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11517:x1875199729414400:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330131.443349:0:5844:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330131.443799:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11517:x1875199729414400:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 217us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.443810:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 171 00000100:00100000:3.0:1788330131.463338:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.464691:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414528 00000100:00100000:1.0:1788330131.464720:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414528 00000100:00100000:1.0:1788330131.464810:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 172 00000100:00100000:1.0:1788330131.464822:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11517:x1875199729414528:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788330131.467669:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467718:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467752:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467776:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467784:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467792:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467834:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467844:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.467851:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330131.468506:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788330131.468624:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330131.468649:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468668:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468675:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468700:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468715:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330131.468721:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468730:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468748:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:1.0:1788330131.468752:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330131.468759:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468765:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab3b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468783:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468790:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468797:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468803:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330131.468806:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468825:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468835:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff954689d7f600) 00010000:00010000:1.0:1788330131.468837:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330131.468841:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468848:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab3b9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468867:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468874:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468881:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.468887:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330131.468891:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.470018:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.470035:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:1.0:1788330131.470038:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330131.470042:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.470060:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.470209:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11517:x1875199729414528:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 Request processed in 5379us (6876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.470222:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 172 00000100:00100000:3.0:1788330131.481983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.482673:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414784 00000100:00100000:3.0:1788330131.482691:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414784 00000100:00100000:3.0:1788330131.482784:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 173 00000100:00100000:3.0:1788330131.482797:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11517:x1875199729414784:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.482826:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330131.482854:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3c7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edef expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484064:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484094:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484111:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330131.484126:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788330131.484272:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484294:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484312:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484319:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330131.484325:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484334:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484350:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:3.0:1788330131.484354:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330131.484360:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.484366:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.485503:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3c7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edef expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.485821:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330131.485826:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330131.485833:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3c7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edef expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.485854:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788330131.486651:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11517:x1875199729414784:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 3850us (4765us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788330131.486664:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 173 00000100:00100000:0.0:1788330131.500699:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330131.500758:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729414912 00000100:00100000:0.0:1788330131.500773:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729414912 00000100:00100000:0.0:1788330131.500840:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 174 00000100:00100000:0.0:1788330131.500853:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11517:x1875199729414912:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330131.500904:0:5845:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330131.502133:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11517:x1875199729414912:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 1270us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.502146:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 174 00000100:00100000:2.0:1788330131.510928:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.511102:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729415168 00000100:00100000:1.0:1788330131.511117:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729415168 00000100:00100000:1.0:1788330131.511191:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 175 00000100:00100000:1.0:1788330131.511203:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11517:x1875199729415168:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330131.511233:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330131.511237:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788330131.511273:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede1 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.511299:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:1.0:1788330131.511314:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330131.511334:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edf6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788330131.512222:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788330131.514473:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab3e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.515257:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.515278:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.515494:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab3dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edf6 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.516388:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edf6 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.516404:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330131.516407:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330131.516412:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface800, rc 0) 00000100:00100000:0.0:1788330131.516663:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11517:x1875199729415168:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 5457us (5748us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1788330131.516675:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 175 00000100:00100000:0.0:1788330131.524198:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.524324:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729415424 00000100:00100000:3.0:1788330131.524338:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729415424 00000100:00100000:3.0:1788330131.524419:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 176 00000100:00100000:3.0:1788330131.524430:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11517:x1875199729415424:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.524512:0:10120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330131.524571:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab3e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edf6 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524595:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:3.0:1788330131.524606:0:10120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330131.524634:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524658:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524670:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524686:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524693:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524700:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524817:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524824:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524831:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524838:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330131.524842:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524850:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524858:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330131.524861:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330131.524865:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524872:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab3f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524888:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524893:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524900:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524911:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330131.524915:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524920:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524927:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x2be3080d (ffff95468a2cc600) 00010000:00010000:3.0:1788330131.524929:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330131.524931:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.524937:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x2be3080d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.525041:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11517:x1875199729415424:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 612us (858us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330131.525066:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 176 00000100:00100000:2.0:1788330131.532855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.533092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729415552 00000100:00100000:3.0:1788330131.533108:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729415552 00000100:00100000:3.0:1788330131.533252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 177 00000100:00100000:3.0:1788330131.533267:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11517:x1875199729415552:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.533296:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330131.533330:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7edfd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.533386:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.533430:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.533445:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.533703:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab3ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.534669:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.534680:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:3.0:1788330131.534683:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330131.534687:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788330131.534813:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11517:x1875199729415552:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1548us (1974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.534822:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 177 00000100:00100000:2.0:1788330131.541313:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.542130:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729415808 00000100:00100000:3.0:1788330131.542149:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729415808 00000100:00100000:3.0:1788330131.542228:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 178 00000100:00100000:3.0:1788330131.542241:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11517:x1875199729415808:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.542803:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.542831:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.542860:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330131.543279:0:10120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788330131.543294:0:10120:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386455775438ns, next at 387455772008ns, rc = 0 00000004:00010000:3.0:1788330131.543594:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000031880c13 reply state 0000000037527822 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.543606:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330131.543824:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11517:x1875199729415808:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 1580us (2537us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788330131.543834:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 178 00010000:00010000:2.0:1788330131.546983:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.547007:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.547016:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.547022:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330131.547029:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.547037:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.547060:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:2.0:1788330131.547063:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788330131.547068:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.547076:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab40d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.547434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330131.547563:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729415936 00000100:00100000:0.0:1788330131.547578:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729415936 00000100:00100000:0.0:1788330131.547644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 179 00000100:00100000:0.0:1788330131.547656:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11517:x1875199729415936:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330131.547688:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330131.547722:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee04 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.547825:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.547841:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.547862:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:0.0:1788330131.547865:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330131.547868:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface400, rc 0) 00000100:00100000:0.0:1788330131.547944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11517:x1875199729415936:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 289us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.547951:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 179 00000100:00100000:2.0:1788330131.551484:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.551737:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729416064 00000100:00100000:1.0:1788330131.551752:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729416064 00000100:00100000:1.0:1788330131.551854:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:1.0:1788330131.551868:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729416064:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788330131.552416:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729416064:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 542us (1108us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788330131.552426:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:2.0:1788330131.557777:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.558208:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729416320 00000100:00100000:1.0:1788330131.558225:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729416320 00000100:00100000:1.0:1788330131.558316:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:1.0:1788330131.558330:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11517:x1875199729416320:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788330131.559053:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11517:x1875199729416320:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 719us (1286us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788330131.559065:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:0.0:1788330131.565044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.565188:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729416576 00000100:00100000:1.0:1788330131.565202:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729416576 00000100:00100000:1.0:1788330131.565283:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 180 00000100:00100000:1.0:1788330131.565296:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11517:x1875199729416576:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330131.565447:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11517:x1875199729416576:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 152us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.565455:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 180 00000100:00100000:0.0:1788330131.569069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.569345:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729416704 00000100:00100000:2.0:1788330131.569361:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729416704 00000100:00100000:2.0:1788330131.569440:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 181 00000100:00100000:2.0:1788330131.569454:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11517:x1875199729416704:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330131.569483:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330131.569512:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab41b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee0b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.572563:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab422 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.572594:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.572611:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330131.572675:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330131.572702:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab422 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.572762:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab41b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee0b expref: 64 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.572810:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab422 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee0b expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.572822:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:0.0:1788330131.572826:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788330131.572830:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacfc00, rc 0) 00000100:00100000:0.0:1788330131.572950:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+63:11517:x1875199729416704:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 3497us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.572961:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 181 00000100:00100000:2.0:1788330131.576823:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330131.576956:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729416832 00000100:00100000:0.0:1788330131.576969:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729416832 00000100:00100000:0.0:1788330131.577054:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:0.0:1788330131.577068:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729416832:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330131.577093:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330131.577120:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee12 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330131.577154:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c093, blocks: 0x1 00010000:00010000:0.0:1788330131.577179:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1788330131.577185:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330131.577197:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.577218:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.577260:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface200, rc 0) 00000100:00100000:0.0:1788330131.577360:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729416832:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 295us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.577368:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:1.0:1788330131.583702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.583804:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417088 00000100:00100000:2.0:1788330131.583819:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417088 00000100:00100000:2.0:1788330131.584164:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 182 00000100:00100000:2.0:1788330131.584178:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+63:11517:x1875199729417088:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788330131.584349:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+63:11517:x1875199729417088:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 174us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.584357:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 182 00000100:00100000:2.0:1788330131.590324:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.590605:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417216 00000100:00100000:1.0:1788330131.590620:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417216 00000100:00100000:1.0:1788330131.590716:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:1.0:1788330131.590730:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:11517:x1875199729417216:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330131.590760:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330131.590791:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee19 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.590875:0:6678:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.590887:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330131.590893:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330131.590900:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.590953:0:6678:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.590970:0:6678:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 9 pid: 6676 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.590990:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf299500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875199750383616:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330131.591139:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a206540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330131.599110:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.599388:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417344 00000100:00100000:2.0:1788330131.599413:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417344 00010000:00010000:2.0:1788330131.599474:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 10 pid: 6676 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330131.599571:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:2.0:1788330131.599585:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2347:x1875199729417344:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330131.599605:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330131.599658:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 10 pid: 6676 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.599677:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 10 pid: 6676 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.599723:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330131.599730:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330131.599742:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.599754:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.599808:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 10 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330131.599827:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875199750383744:192.168.202.47@tcp:105: 00000100:00100000:2.0:1788330131.600327:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1788330131.601874:0:6678:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4627803/0x91094de4de9ab429 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee12 expref: 10 pid: 6676 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.601904:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf299500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6678:1875199750383616:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330131.601956:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 9 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.601973:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508000, rc 0) 00000100:00100000:1.0:1788330131.602079:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:11517:x1875199729417216:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 11351us (11781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.602089:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:2.0:1788330131.609619:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5831:1875199750383744:192.168.202.47@tcp:105: 00010000:00010000:2.0:1788330131.609669:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330131.609765:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729417344:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 10182us (10670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.609780:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:0.0:1788330131.615570:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750383872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330131.615731:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330131.616109:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750383872 00000100:00100000:1.0:1788330131.616121:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750383872 00000100:00100000:1.0:1788330131.616223:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330131.616235:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750383872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330131.616310:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330131.616417:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750383872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 172us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.616426:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788330131.616491:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750383872:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788330131.618508:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330131.619178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.619264:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417472 00000100:00100000:3.0:1788330131.619277:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417472 00002000:00100000:3.0:1788330131.619353:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9546bfb7ce00 x1875199729417472/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:147/0 lens 504/0 e 0 to 0 dl 1788330142 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330131.619366:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfb7ce00 with x1875199729417472 ext(0->8) 00002000:00010000:3.0:1788330131.619373:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bfb7ce00 00000100:00100000:3.0:1788330131.619415:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:3.0:1788330131.619426:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729417472:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788330131.620091:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2346:x1875199729417472:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 Request processed in 662us (920us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788330131.620101:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00002000:00100000:3.0:1788330131.620110:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9546bfb7ce00 x1875199729417472/t4294967314(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:147/0 lens 504/448 e 0 to 0 dl 1788330142 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330131.620132:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfb7ce00 with x1875199729417472 ext(0->8) 00002000:00010000:3.0:1788330131.620137:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9546bfb7ce00 00000100:00100000:1.0:1788330131.623831:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750384000:0@lo:400:kworker.0 00000100:00100000:1.0:1788330131.623942:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330131.624055:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384000 00000100:00100000:1.0:1788330131.624065:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384000 00000100:00100000:1.0:1788330131.624125:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788330131.624136:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750384000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330131.624200:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750384000:12345-0@lo:400:kworker.0 Request processed in 65us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.624208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788330131.624277:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750384000:0@lo:400:kworker.0 00000100:00100000:2.0:1788330131.624565:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750384256:0@lo:400:kworker.0 00000100:00100000:2.0:1788330131.624605:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330131.625548:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750384128:0@lo:400:kworker.0 00000100:00100000:3.0:1788330131.625600:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330131.625662:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384256 00000100:00100000:3.0:1788330131.625670:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384256 00000100:00100000:3.0:1788330131.625734:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384128 00000100:00100000:3.0:1788330131.625738:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384128 00000100:00100000:3.0:1788330131.625762:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788330131.625770:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750384256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330131.626055:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330131.626064:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750384512:0@lo:400:kworker.0 00000100:00100000:1.0:1788330131.626804:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750384384:0@lo:400:kworker.0 00000100:00100000:1.0:1788330131.626851:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330131.626912:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384384 00000100:00100000:1.0:1788330131.626934:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384384 00000100:00100000:1.0:1788330131.626987:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788330131.626996:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750384384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330131.627045:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750384384:12345-0@lo:400:kworker.0 Request processed in 50us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.627052:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788330131.627103:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750384384:0@lo:400:kworker.0 00000100:00100000:2.0:1788330131.627213:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330131.627333:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750384256:12345-0@lo:400:kworker.0 Request processed in 1561us (2724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.627342:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788330131.627356:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384512 00000100:00100000:3.0:1788330131.627359:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384512 00000100:00100000:3.0:1788330131.627378:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788330131.627385:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750384128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330131.627446:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750384128:12345-0@lo:400:kworker.0 Request processed in 61us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.627453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788330131.627464:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788330131.627470:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750384512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330131.627498:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750384512:12345-0@lo:400:kworker.0 Request processed in 29us (1402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.627505:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:3.0:1788330131.627565:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330131.627571:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330131.627686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.628003:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750384512:0@lo:400:kworker.0 00000100:00100000:2.0:1788330131.628018:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750384128:0@lo:400:kworker.0 00000100:00100000:1.0:1788330131.628149:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417600 00000100:00100000:1.0:1788330131.628155:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417600 00000100:00100000:1.0:1788330131.628196:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 183 00000100:00100000:1.0:1788330131.628204:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+63:11517:x1875199729417600:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788330131.634583:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750384256:0@lo:400:kworker.0 00000001:00080000:2.0:1788330131.676235:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:2.0:1788330131.676310:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788330131.677333:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788330131.677364:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788330131.677388:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95469b5b0000 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788330131.677395:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95469b86c300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff95469b5b00c0 00000020:00080000:3.0:1788330131.677398:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95469b86c800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95469b4e7000 00000020:00080000:3.0:1788330131.677432:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1788330131.677731:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788330131.678054:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788330131.678081:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750384640:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788330131.678183:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330131.678256:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384640 00000100:00100000:2.0:1788330131.678267:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384640 00000100:00100000:2.0:1788330131.678347:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788330131.678360:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1875199750384640:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788330131.678470:0:8194:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1788330131.678550:0:8194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a97c090, atime: 0x6a97c091, ctime: 0x6a97c090, blocks: 0x1 00010000:00010000:2.0:1788330131.678562:0:8194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.678584:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1788330131.678590:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330131.678598:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.678621:0:8194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.678927:0:8194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.678936:0:8194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.678958:0:8194:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788330131.679987:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750384640:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1623us (1798us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788330131.680000:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00010000:2.0:1788330131.680060:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330131.680070:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.680082:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dae00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330131.680087:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.680099:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.680125:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.680132:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007083b50a/0x91094de4de9ab437 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.680167:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330131.680170:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330131.680172:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788330131.680467:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469b4f1880/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788330131.680477:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750384640:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788330131.680850:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750384768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788330131.680917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330131.681286:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+18:11517:x1875199729417600:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 Request processed in 53076us (53597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.683002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 183 00000100:00100000:0.0:1788330131.683853:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750384768 00000100:00100000:0.0:1788330131.683869:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750384768 00000100:00100000:0.0:1788330131.683952:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788330131.683966:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750384768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788330131.684253:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788330131.684257:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788330132 00002000:00010000:0.0:1788330131.684260:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788330131.684263:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788330131 -> 1788330132 00002000:00010000:0.0:1788330131.684265:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788330131.686095:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.686636:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417728 00000100:00100000:1.0:1788330131.686649:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417728 00000100:00100000:1.0:1788330131.686720:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 58 00000100:00100000:1.0:1788330131.686732:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2346:x1875199729417728:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788330131.689805:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf829c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750384768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 5826us (8871us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788330131.689846:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000004:00080000:3.0:1788330131.690114:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469b4f1180/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788330131.690124:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750384768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788330131.733643:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2346:x1875199729417728:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 Request processed in 46894us (47542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.733663:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 58 00000001:00080000:0.0:1788330131.735753:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:0.0:1788330131.735782:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:0.0:1788330131.735791:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:1.0:1788330131.738041:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.738336:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729417984 00000100:00100000:3.0:1788330131.738354:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729417984 00000100:00100000:3.0:1788330131.738460:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 184 00000100:00100000:3.0:1788330131.738473:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+18:11517:x1875199729417984:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.738600:0:10120:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330131.738643:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfc00/0x91094de4de9ab422 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee0b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.738668:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:3.0:1788330131.738674:0:10120:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330131.738729:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.738766:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.738777:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330131.739133:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f57c3137 reply state 00000000deca44d9 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.739146:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330131.739641:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11517:x1875199729417984:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 1166us (1613us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788330131.739652:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 184 00000100:00100000:2.0:1788330131.745886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:3.0:1788330131.746349:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.746366:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.746375:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.746381:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330131.746387:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.746397:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.746430:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:3.0:1788330131.746454:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330131.746461:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.746468:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab43e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.746804:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729418112 00000100:00100000:1.0:1788330131.746818:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729418112 00000100:00100000:1.0:1788330131.746940:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:1.0:1788330131.746953:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729418112:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788330131.747393:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788330131.747398:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788330132 -> 1788330130 00002000:00010000:1.0:1788330131.747457:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788330129 00002000:00010000:1.0:1788330131.747461:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788330132 -> 1788330130 00002000:00010000:1.0:1788330131.747464:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788330131.747599:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729418112:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 647us (1729us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788330131.747610:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:0.0:1788330131.752964:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.753088:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729418368 00000100:00100000:3.0:1788330131.753105:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729418368 00000100:00100000:3.0:1788330131.753212:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 185 00000100:00100000:3.0:1788330131.753225:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+18:11517:x1875199729418368:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.753337:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.753357:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.753368:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.753559:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.753577:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 18 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.753598:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750384896:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330131.753733:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330131.757138:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750384896:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330131.757182:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330131.759999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.761676:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729418496 00000100:00100000:3.0:1788330131.761728:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729418496 00010000:00010000:3.0:1788330131.761794:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 19 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.761904:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00100000:3.0:1788330131.761917:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a371050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:2347:x1875199729418496:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330131.761940:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330131.761949:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 19 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.761965:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 19 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.761996:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7edfd expref: 19 pid: 5844 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.762019:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:3.0:1788330131.762025:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.762036:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.762046:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.762091:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330131.762177:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a371050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+18:2347:x1875199729418496:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 262us (2196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.762198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 69 00010000:00010000:0.0:1788330131.763224:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763243:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763286:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763294:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763314:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763321:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330131.763327:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763335:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763355:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:0.0:1788330131.763359:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788330131.763378:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.763386:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab445 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330131.763499:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+17:11517:x1875199729418368:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 Request processed in 10271us (10547us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788330131.763509:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 185 00000100:00100000:0.0:1788330131.766860:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330131.766974:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729418624 00000100:00100000:1.0:1788330131.766988:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729418624 00000100:00100000:1.0:1788330131.767117:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:1.0:1788330131.767128:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729418624:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788330131.767183:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.767205:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.767213:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330131.767218:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330131.767221:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.767260:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.767295:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 8 pid: 6678 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.767313:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf29b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875199750385024:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330131.767432:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b46c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330131.772938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.773025:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729418752 00000100:00100000:2.0:1788330131.773039:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729418752 00010000:00010000:2.0:1788330131.773103:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 9 pid: 6678 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330131.773156:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 70 00000100:00100000:2.0:1788330131.773172:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729418752:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330131.773195:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330131.773224:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 9 pid: 6678 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.773238:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 9 pid: 6678 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.773267:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330131.773272:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330131.773307:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.773320:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.773343:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330131.773408:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729418752:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 241us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.773414:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 70 00010000:00010000:1.0:1788330131.775044:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cde03ba0/0x91094de4de9ab430 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee19 expref: 8 pid: 6678 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.775074:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf29b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875199750385024:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330131.775112:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775126:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775134:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775180:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775189:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775223:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775230:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330131.775235:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775245:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775265:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330131.775272:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dac0ec2/0x91094de4de9ab44c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330131.775396:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729418624:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 Request processed in 8269us (8547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330131.775414:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:0.0:1788330131.781399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.781615:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729419008 00000100:00100000:3.0:1788330131.781630:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729419008 00000100:00100000:3.0:1788330131.781724:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 186 00000100:00100000:3.0:1788330131.781739:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+17:11517:x1875199729419008:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788330131.781854:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.781877:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.781892:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.782197:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.782211:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.782220:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.782265:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.782282:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 18 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.782716:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750385152:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330131.782870:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330131.787831:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.788139:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729419136 00000100:00100000:2.0:1788330131.788154:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729419136 00010000:00010000:2.0:1788330131.788213:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 19 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330131.788268:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 71 00000100:00100000:2.0:1788330131.788281:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:2347:x1875199729419136:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330131.788310:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330131.788324:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 19 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.788343:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 19 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.788373:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:2.0:1788330131.788380:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.788423:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.788432:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.788457:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330131.788845:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:2347:x1875199729419136:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 563us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330131.788855:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 71 00010000:00010000:3.0:1788330131.789254:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab414 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee04 expref: 18 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.789277:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf82aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750385152:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330131.789460:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.791203:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.791221:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330131.791808:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788330131.792007:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788330131.792063:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788330131.792191:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b4f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750385280:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788330131.792670:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330131.792799:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330131.792857:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750385280 00000100:00100000:0.0:1788330131.792868:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750385280 00000100:00100000:0.0:1788330131.793215:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330131.793231:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875199750385280:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788330131.793368:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875199750385280:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330131.793376:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788330131.793453:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788330131.793460:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469b4f1180, transno 4294967315 00000100:00100000:2.0:1788330131.793488:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b4f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750385280:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788330131.794143:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788330131.794247:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750385408:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788330131.794296:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330131.795591:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a33693c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330131.795748:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750385408 00000100:00100000:1.0:1788330131.795760:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750385408 00000100:00100000:1.0:1788330131.795821:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330131.795831:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875199750385408:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788330131.796175:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875199750385408:12345-0@lo:1000:mdt00_002.0 Request processed in 344us (1877us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788330131.796196:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330131.796400:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5846:1875199750385408:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788330131.796510:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796553:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796562:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796568:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330131.796574:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796583:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796604:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc600) 00010000:00010000:2.0:1788330131.796607:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330131.796613:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796619:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab45a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796660:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796667:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796674:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796688:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330131.796692:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796698:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796720:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:2.0:1788330131.796723:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330131.796726:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796732:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab38f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796762:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796781:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796793:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796837:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.796856:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 21 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330131.796886:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469ba4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750385536:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330131.796985:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a33693c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330131.803930:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330131.804292:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469ba4e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750385536:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330131.804670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729419264 00000100:00100000:3.0:1788330131.804681:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729419264 00010000:00010000:3.0:1788330131.804752:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 22 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330131.804811:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:3.0:1788330131.804823:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+22:2346:x1875199729419264:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330131.804845:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330131.804854:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 22 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.804870:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 22 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.804901:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab3ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ede8 expref: 22 pid: 5846 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.804949:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:3.0:1788330131.804956:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.804968:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.804977:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330131.805002:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330131.805077:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+21:2346:x1875199729419264:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 255us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330131.805086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 72 00010000:00010000:2.0:1788330131.805736:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805747:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805753:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805770:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805778:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805786:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805793:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dae00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330131.805798:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805807:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805821:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:2.0:1788330131.805835:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330131.805840:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805847:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab461 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805865:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805871:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805877:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805882:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330131.805886:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805892:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805901:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6d00) 00010000:00010000:2.0:1788330131.805903:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330131.805906:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.805912:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab453 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330131.808847:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330131.808863:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788330131.810112:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11517:x1875199729419008:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 28361us (28715us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788330131.810133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 186 00000020:00080000:3.0:1788330131.810143:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788330131.810850:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788330131.810868:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330131.815509:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330131.815788:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729419520 00000100:00100000:3.0:1788330131.815801:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729419520 00000100:00100000:3.0:1788330131.815881:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:3.0:1788330131.815894:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11517:x1875199729419520:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788330131.817116:0:5848:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788330131.817238:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788330131.819103:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.819135:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.819151:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.819162:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.819170:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.819177:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330131.819271:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788330131.819476:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d54c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:11517:x1875199729419520:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 3576us (3977us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788330131.819489:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 50 00000020:00080000:2.0:1788330131.819498:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788330131.821219:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330131.821239:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.821253:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330131.821259:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.821270:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.821343:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff95468a2cc300) 00010000:00010000:0.0:1788330131.821347:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788330131.821353:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.821360:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab468 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330131.821391:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330131.821394:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330131.821395:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330132.255349:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330132.832211:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330132.832221:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330132.832255:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788330132.832279:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788330133.281480:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788330133.504981:0:12559:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788330133.504991:0:12559:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788330133.505030:0:12559:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788330133.505037:0:12559:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788330133.638861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330133.638937:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729419776 00000100:00100000:2.0:1788330133.638948:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729419776 00000100:00100000:2.0:1788330133.639034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 187 00000100:00100000:2.0:1788330133.639045:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+22:11535:x1875199729419776:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330133.639070:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330133.639091:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab46f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee20 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788330133.639091:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788330133.639188:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da400/0x91094de4de9ab476 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.639202:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da400/0x91094de4de9ab476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.639215:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da400/0x91094de4de9ab476 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330133.639227:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788330133.639375:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab46f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee20 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.639395:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da400/0x91094de4de9ab476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee20 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.639405:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330133.639408:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330133.639413:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da400, rc 0) 00000100:00100000:2.0:1788330133.639487:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11535:x1875199729419776:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 443us (637us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788330133.639495:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 187 00000100:00100000:3.0:1788330133.650455:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330133.653161:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729419904 00000100:00100000:0.0:1788330133.653178:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729419904 00000100:00100000:0.0:1788330133.653256:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 188 00000100:00100000:0.0:1788330133.653269:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11535:x1875199729419904:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:0.0:1788330133.653361:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653379:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653399:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653414:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653420:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653436:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653913:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653921:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653928:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788330133.653966:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653982:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653988:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.653995:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654000:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330133.654005:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654012:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654023:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330133.654031:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330133.654036:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654043:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654054:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654060:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654066:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654071:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330133.654074:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654079:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654086:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330133.654088:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330133.654090:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654095:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab48b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654107:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654117:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654122:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654127:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330133.654130:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654135:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654143:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330133.654145:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330133.654147:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.654152:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330133.654239:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf82aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11535:x1875199729419904:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 971us (3797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330133.654247:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 188 00000100:00100000:3.0:1788330133.662806:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330133.662832:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750385664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330133.662907:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330133.662978:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750385664 00000100:00100000:3.0:1788330133.662987:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750385664 00000100:00100000:3.0:1788330133.663040:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330133.663050:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750385664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330133.663082:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330133.663128:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfcfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750385664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330133.663136:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788330133.663180:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf4f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750385664:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788330133.663308:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330133.709248:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330133.711237:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729420160 00000100:00100000:3.0:1788330133.711253:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729420160 00000100:00100000:3.0:1788330133.711323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 189 00000100:00100000:3.0:1788330133.711333:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11538:x1875199729420160:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330133.711354:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330133.711373:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab499 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee27 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.711449:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.711463:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.711485:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.711499:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.711506:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.711513:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.711930:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.711940:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.711949:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330133.711959:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788330133.712315:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712325:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712331:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712337:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330133.712342:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712349:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712362:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:1.0:1788330133.712366:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330133.712375:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712381:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab4a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712395:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712401:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712406:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712411:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330133.712414:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712419:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712425:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95468a2cc800) 00010000:00010000:1.0:1788330133.712427:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330133.712429:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712435:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab4a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712479:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712504:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.712511:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:1.0:1788330133.712514:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330133.712542:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508800, rc 0) 00000100:00100000:1.0:1788330133.712621:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+26:11538:x1875199729420160:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1287us (3384us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788330133.712629:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 189 00000100:00100000:2.0:1788330133.723541:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330133.723608:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729420288 00000100:00100000:2.0:1788330133.723618:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729420288 00000100:00100000:2.0:1788330133.724941:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 190 00000100:00100000:2.0:1788330133.724965:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+26:11538:x1875199729420288:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:2.0:1788330133.725058:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725076:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725087:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725114:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725122:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725128:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725134:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2daa00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330133.725138:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725145:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725156:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:2.0:1788330133.725160:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330133.725172:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.725178:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab4bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330133.725280:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+26:11538:x1875199729420288:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 323us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330133.725289:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 190 00000100:00100000:3.0:1788330133.736294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330133.736334:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729420544 00000100:00100000:3.0:1788330133.736345:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729420544 00000100:00100000:3.0:1788330133.736397:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:3.0:1788330133.736407:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+26:11538:x1875199729420544:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330133.736900:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+27:11538:x1875199729420544:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 493us (644us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788330133.736909:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:2.0:1788330133.782205:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330133.782758:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729420800 00000100:00100000:0.0:1788330133.782873:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729420800 00000100:00100000:0.0:1788330133.782928:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 191 00000100:00100000:0.0:1788330133.782937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+27:11063:x1875199729420800:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330133.782975:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330133.782995:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab4c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee2e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.783203:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.783220:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.783229:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.783278:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.783291:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 28 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330133.783304:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b8b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750385792:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330133.784509:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330133.792324:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330133.792407:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729420928 00000100:00100000:0.0:1788330133.792424:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729420928 00010000:00010000:0.0:1788330133.792470:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 29 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330133.792509:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:0.0:1788330133.792642:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:2347:x1875199729420928:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330133.792671:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330133.792676:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 29 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.792698:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 29 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.792727:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:0.0:1788330133.792732:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.792743:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.792752:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330133.792774:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330133.792831:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:2347:x1875199729420928:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 313us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330133.792839:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 73 00010000:00010000:2.0:1788330133.792949:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508800/0x91094de4de9ab4ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee27 expref: 28 pid: 5845 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330133.792966:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b8b7100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750385792:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330133.792985:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.792995:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.793001:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330133.793030:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788330133.793181:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab4c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.793197:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.793217:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:2.0:1788330133.793220:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330133.793223:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf800, rc 0) 00000100:00100000:2.0:1788330133.793264:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+28:11063:x1875199729420800:12345-192.168.202.47@tcp:101:bash.0 Request processed in 10328us (11071us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1788330133.793270:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 191 00000100:00100000:1.0:1788330133.798245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330133.798326:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729421184 00000100:00100000:2.0:1788330133.798337:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729421184 00000100:00100000:2.0:1788330133.798510:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 192 00000100:00100000:2.0:1788330133.798565:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+28:11063:x1875199729421184:12345-192.168.202.47@tcp:36:bash.0 00010000:00010000:2.0:1788330133.798850:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.798868:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.798880:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330133.798923:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788330133.798944:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000007fccc05 reply state 0000000012da9af3 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330133.798953:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788330133.798990:0:10120:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788330133.799198:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11063:x1875199729421184:12345-192.168.202.47@tcp:36:bash.0 Request processed in 637us (964us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788330133.799206:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 192 00000020:00080000:2.0:1788330133.799223:0:10120:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788330133.803189:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803208:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803217:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803241:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dac00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330133.803247:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803255:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803273:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:3.0:1788330133.803275:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330133.803280:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803285:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab4d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330133.803410:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330133.803599:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729421312 00000100:00100000:3.0:1788330133.803610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729421312 00000100:00100000:3.0:1788330133.803677:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 193 00000100:00100000:3.0:1788330133.803699:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+31:11063:x1875199729421312:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330133.803727:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330133.803744:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab4df lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee35 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803806:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee35 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803820:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab4df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee35 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330133.803852:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:3.0:1788330133.803854:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330133.803857:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9400, rc 0) 00000100:00100000:3.0:1788330133.803915:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11063:x1875199729421312:12345-192.168.202.47@tcp:101:bash.0 Request processed in 228us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330133.803922:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 193 00000100:00100000:0.0:1788330133.813266:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330133.816757:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729421440 00000100:00100000:2.0:1788330133.816773:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729421440 00000100:00080000:0.0:1788330133.816891:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330133.816939:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:2.0:1788330133.816953:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:11063:x1875199729421440:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330133.816974:0:6678:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330133.816998:0:6678:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee3c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788330133.817039:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a97c092, atime: 0x6a97c091, ctime: 0x6a97c092, blocks: 0xb 00010000:00010000:2.0:1788330133.817067:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:2.0:1788330133.817073:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330133.817082:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.817100:0:6678:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 8 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330133.817115:0:6678:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2db400, rc 0) 00000100:00100000:2.0:1788330133.817318:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:11063:x1875199729421440:12345-192.168.202.47@tcp:101:bash.0 Request processed in 368us (4061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330133.817326:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:3.0:1788330133.829811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330133.829976:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729421568 00000100:00100000:1.0:1788330133.829987:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729421568 00002000:00010000:1.0:1788330133.830042:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788330133.830047:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff954584b2df80 with x1875199729421568 ext(0->18446744073709551615) 00002000:00010000:1.0:1788330133.830060:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff954584b2df80. 00000100:00100000:1.0:1788330133.830093:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:1.0:1788330133.830103:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2348:x1875199729421568:12345-192.168.202.47@tcp:10:bash.0 00002000:00010000:1.0:1788330133.830391:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788330133.830395:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788330130 -> 1788330134 00002000:00010000:1.0:1788330133.830398:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788330129 -> 1788330129 00002000:00010000:1.0:1788330133.830401:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788330130 -> 1788330134 00002000:00010000:1.0:1788330133.830403:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788330133.830474:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2348:x1875199729421568:12345-192.168.202.47@tcp:10:bash.0 Request processed in 373us (677us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788330133.830497:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00002000:00010000:1.0:1788330133.830501:0:6684:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788330133.830503:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff954584b2df80 with x1875199729421568 ext(0->18446744073709551615) 00002000:00010000:1.0:1788330133.830507:0:6684:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff954584b2df80. 00000100:00100000:0.0:1788330133.997663:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330133.997766:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729421696 00000100:00100000:1.0:1788330133.997777:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729421696 00000100:00100000:1.0:1788330133.997841:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 194 00000100:00100000:1.0:1788330133.997852:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11552:x1875199729421696:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:1.0:1788330133.997925:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.997943:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.997955:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.997969:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.997976:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.997982:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998231:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998240:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998254:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788330133.998295:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998306:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998314:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998322:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998328:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330133.998332:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998339:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998351:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:1.0:1788330133.998354:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330133.998358:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998364:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab4ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998374:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998385:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998391:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998396:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330133.998399:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998404:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998422:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954689d7fd00) 00010000:00010000:1.0:1788330133.998425:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330133.998428:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998432:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9ab4f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998447:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998453:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998459:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998464:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330133.998472:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998478:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998486:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:1.0:1788330133.998489:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330133.998491:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330133.998498:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab4fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330133.998631:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11552:x1875199729421696:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 780us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330133.998638:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 194 00000100:00100000:0.0:1788330134.062985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.063116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729421952 00000100:00100000:2.0:1788330134.063125:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729421952 00000100:00100000:2.0:1788330134.063181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 195 00000100:00100000:2.0:1788330134.063188:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11555:x1875199729421952:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330134.063206:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330134.063234:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee43 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063300:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063315:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063326:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063342:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063349:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063356:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063705:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063715:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063722:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330134.063732:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788330134.063821:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063838:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063846:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063852:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330134.063858:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063866:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063878:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330134.063881:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330134.063885:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063892:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab509 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063904:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063908:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063912:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063915:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2db800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330134.063921:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063925:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063930:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606100) 00010000:00010000:2.0:1788330134.063931:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330134.063933:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063936:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063965:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee43 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063974:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee43 expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.063979:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:2.0:1788330134.063980:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788330134.063982:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2db600, rc 0) 00000100:00100000:2.0:1788330134.065206:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11555:x1875199729421952:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 2012us (2223us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1788330134.065215:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 195 00000100:00100000:2.0:1788330134.079940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330134.080064:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729422080 00000100:00100000:1.0:1788330134.080076:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729422080 00000100:00100000:1.0:1788330134.080141:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 196 00000100:00100000:1.0:1788330134.080153:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11555:x1875199729422080:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:1.0:1788330134.080225:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.080244:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.080254:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.080291:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 34 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.080319:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 34 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.080336:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750385920:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330134.080431:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330134.085801:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc27480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5846:1875199750385920:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330134.085840:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330134.098256:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.098530:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729422336 00000100:00100000:3.0:1788330134.098541:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729422336 00000100:00100000:3.0:1788330134.098606:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:3.0:1788330134.098617:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+35:5589:x1875199729422336:12345-192.168.202.47@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788330134.098977:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+36:5589:x1875199729422336:12345-192.168.202.47@tcp:35:ldlm_bl.0 Request processed in 361us (732us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788330134.098986:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:0.0:1788330134.105712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.105824:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729422464 00000100:00100000:2.0:1788330134.105836:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729422464 00010000:00010000:2.0:1788330134.105904:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 36 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330134.105951:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:2.0:1788330134.105963:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+36:2346:x1875199729422464:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330134.105979:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330134.105987:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 36 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.106004:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 36 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.106039:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab4ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee2e expref: 36 pid: 5844 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.106058:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:2.0:1788330134.106064:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.106075:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.106082:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.106124:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330134.106182:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+35:2346:x1875199729422464:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 221us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330134.106190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 74 00010000:00010000:0.0:1788330134.106631:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106652:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106697:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106705:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106712:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106717:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330134.106721:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106728:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106740:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:0.0:1788330134.106743:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330134.106746:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.106752:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9ab525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.106800:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469ba4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11555:x1875199729422080:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 26648us (26869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330134.106808:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 196 00000100:00100000:0.0:1788330134.109707:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.109778:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729422720 00000100:00100000:3.0:1788330134.109792:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729422720 00000100:00100000:3.0:1788330134.109860:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:3.0:1788330134.109871:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+34:11555:x1875199729422720:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330134.110107:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+35:11555:x1875199729422720:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 237us (422us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788330134.110116:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:2.0:1788330134.266918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.266968:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729422976 00000100:00100000:2.0:1788330134.266978:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729422976 00000100:00100000:2.0:1788330134.267469:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 197 00000100:00100000:2.0:1788330134.267489:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+35:11566:x1875199729422976:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:2.0:1788330134.267552:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330134.267578:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab52c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee4a expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.267655:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.267672:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.267701:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.267718:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.267726:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.267733:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268677:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab541 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268702:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268721:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab541 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330134.268733:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788330134.268917:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268925:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268931:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268937:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dbe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330134.268941:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268949:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268962:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330134.268966:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330134.268970:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268977:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab533 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268992:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.268999:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269387:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269394:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330134.269397:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269404:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269413:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606500) 00010000:00010000:2.0:1788330134.269416:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330134.269419:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269425:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab53a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269476:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab52c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee4a expref: 38 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269491:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab541 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee4a expref: 37 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.269498:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:2.0:1788330134.269500:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330134.269503:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dbc00, rc 0) 00000100:00100000:2.0:1788330134.269628:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546beff8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11566:x1875199729422976:12345-192.168.202.47@tcp:101:cat.0 Request processed in 2149us (2722us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1788330134.269647:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 197 00000100:00100000:2.0:1788330134.281620:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.282038:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729423232 00000100:00100000:3.0:1788330134.282059:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729423232 00000100:00100000:3.0:1788330134.282151:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 54 00000100:00100000:3.0:1788330134.282167:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11566:x1875199729423232:12345-192.168.202.47@tcp:35:cat.0 00000100:00100000:3.0:1788330134.284812:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+38:11566:x1875199729423232:12345-192.168.202.47@tcp:35:cat.0 Request processed in 2631us (3186us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788330134.284831:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 54 00000001:00080000:2.0:1788330134.297228:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:2.0:1788330134.297256:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1788330134.297271:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:2.0:1788330134.303240:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330134.310326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.310457:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729423488 00000100:00100000:3.0:1788330134.310474:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729423488 00000100:00100000:3.0:1788330134.310590:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 198 00000100:00100000:3.0:1788330134.310604:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+38:11567:x1875199729423488:12345-192.168.202.47@tcp:36:rm.0 00010000:00010000:3.0:1788330134.310713:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788330134.310753:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbc00/0x91094de4de9ab541 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee4a expref: 38 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.310784:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee43 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.310799:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab4df lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee35 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.310812:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff954689d7fc00) 00010000:00010000:3.0:1788330134.310827:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330134.310861:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.311635:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.311789:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.311849:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.311857:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.311864:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.312325:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.312335:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.312344:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330134.316179:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788330134.316200:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 389228681462ns, next at 390228676314ns, rc = 0 00010000:00010000:3.0:1788330134.316305:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.316325:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.316338:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.316349:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.316369:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.316375:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.316409:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330134.316667:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330134.316677:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.316694:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330134.316698:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.316707:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.316725:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95468a2cc900) 00010000:00010000:0.0:1788330134.316728:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788330134.316734:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.316741:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9200/0x91094de4de9ab564 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.316761:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330134.316763:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330134.316765:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330134.317079:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317088:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317094:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317099:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.317104:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317111:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317122:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff95468a2cc900) 00010000:00010000:3.0:1788330134.317125:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788330134.317128:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317135:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab55d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317162:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317182:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317187:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317192:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.317195:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317201:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317210:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330134.317212:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330134.317215:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.317220:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab54f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330134.317237:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000cb6d500 reply state 0000000050949f45 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.317249:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330134.317944:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+37:11567:x1875199729423488:12345-192.168.202.47@tcp:36:rm.0 Request processed in 7255us (7548us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788330134.317959:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 198 00010000:00010000:0.0:1788330134.321214:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.321240:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.321249:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.321256:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330134.321282:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.321292:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.321317:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95468a2ccb00) 00010000:00010000:0.0:1788330134.321320:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330134.321326:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.321333:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9000/0x91094de4de9ab556 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.356294:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.356460:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729423744 00000100:00100000:2.0:1788330134.356474:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729423744 00000100:00100000:3.0:1788330134.356918:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 199 00000100:00100000:3.0:1788330134.356947:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+36:11573:x1875199729423744:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330134.356989:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330134.357025:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab56b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee51 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357140:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357154:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357164:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357180:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357187:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357193:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330134.357811:0:10120:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788330134.357975:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357987:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.357995:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358044:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358051:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358058:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358065:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.358070:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358077:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358090:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330134.358092:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330134.358097:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358102:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab572 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330134.358117:0:10120:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007705e502 reply state 00000000d3090547 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.358125:0:10120:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788330134.358157:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab56b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 39 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358185:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 38 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.358192:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:3.0:1788330134.358195:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330134.358197:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9e00, rc 0) 00000100:00100000:3.0:1788330134.358273:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+39:11573:x1875199729423744:12345-192.168.202.47@tcp:101:bash.0 Request processed in 1341us (1996us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788330134.358280:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 199 00000100:00100000:2.0:1788330134.362266:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:3.0:1788330134.362286:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.362302:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.362311:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.362318:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.362323:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.362331:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.362349:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95468a2cc900) 00010000:00010000:3.0:1788330134.362352:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330134.362356:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.362383:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab579 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.363370:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729423872 00000100:00100000:1.0:1788330134.363395:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729423872 00000100:00100000:1.0:1788330134.363476:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 62 00000100:00100000:1.0:1788330134.363487:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2347:x1875199729423872:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:1.0:1788330134.363507:0:8194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330134.363554:0:8194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee58 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330134.363585:0:8194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330134.363607:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=389s v=(0 0) 00010000:00010000:1.0:1788330134.363613:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330134.363624:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 6 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.363663:0:8194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 6 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.363676:0:8194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508000, rc 0) 00000100:00100000:1.0:1788330134.363762:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729423872:12345-192.168.202.47@tcp:101:bash.0 Request processed in 276us (1510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330134.363770:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 62 00000100:00080000:0.0:1788330134.364382:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330134.370051:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330134.370197:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729424000 00000100:00100000:1.0:1788330134.370214:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729424000 00000100:00100000:1.0:1788330134.370307:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 63 00000100:00100000:1.0:1788330134.370319:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:11573:x1875199729424000:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:1.0:1788330134.370336:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330134.370355:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee5f expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.370396:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.370406:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330134.370410:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330134.370415:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.370451:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.370482:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.370498:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875199750386048:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330134.370927:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788330134.373082:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6677:1875199750386048:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330134.373116:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.373136:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508600, rc 0) 00000100:00100000:1.0:1788330134.373195:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:11573:x1875199729424000:12345-192.168.202.47@tcp:101:bash.0 Request processed in 2876us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330134.373204:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 63 00000100:00100000:3.0:1788330134.376642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.376881:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729424128 00000100:00100000:0.0:1788330134.376892:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729424128 00010000:00010000:0.0:1788330134.376934:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.377030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:0.0:1788330134.377040:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729424128:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330134.377057:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330134.377081:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.377096:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.377141:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cde03ba0/0x91094de4de9ab58e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee58 expref: 7 pid: 8194 timeout: 489 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.377160:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330134.377165:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330134.377174:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.377183:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.377226:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.377245:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b8b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875199750386176:192.168.202.47@tcp:105: 00000100:00100000:0.0:1788330134.377357:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330134.381185:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.381350:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b8b5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5830:1875199750386176:192.168.202.47@tcp:105: 00010000:00010000:0.0:1788330134.381374:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330134.381440:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2346:x1875199729424128:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 4400us (4806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330134.381450:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:3.0:1788330134.382195:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729424384 00000100:00100000:3.0:1788330134.382206:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729424384 00000100:00100000:2.0:1788330134.382345:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:2.0:1788330134.382356:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+38:11573:x1875199729424384:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:2.0:1788330134.382738:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+39:11573:x1875199729424384:12345-192.168.202.47@tcp:35:bash.0 Request processed in 383us (1564us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788330134.382745:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 55 00000100:00100000:2.0:1788330134.556629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.556783:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729424512 00000100:00100000:0.0:1788330134.556793:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729424512 00000100:00100000:0.0:1788330134.556855:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 200 00000100:00100000:0.0:1788330134.556881:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+39:11589:x1875199729424512:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330134.556907:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330134.556929:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee66 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.556996:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.557010:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.557022:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330134.557056:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788330134.557060:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330134.557077:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.557101:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee66 expref: 41 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.557118:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee66 expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.557126:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330134.557129:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330134.557132:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface400, rc 0) 00000100:00100000:0.0:1788330134.557191:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11589:x1875199729424512:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 312us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330134.557208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 200 00000100:00100000:1.0:1788330134.562399:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.562710:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729424768 00000100:00100000:0.0:1788330134.562720:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729424768 00000100:00100000:0.0:1788330134.562783:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 201 00000100:00100000:0.0:1788330134.562792:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+40:11589:x1875199729424768:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330134.562812:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330134.562835:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5aa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee6d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.562942:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab5b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.562955:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.562967:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab5b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330134.562979:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788330134.563120:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee6d expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.563142:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab5b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee6d expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.563151:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:0.0:1788330134.563154:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330134.563158:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330134.563246:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+42:11589:x1875199729424768:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 454us (864us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788330134.563253:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 201 00000100:00100000:2.0:1788330134.568218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.568315:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425024 00000100:00100000:0.0:1788330134.568325:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425024 00000100:00100000:0.0:1788330134.568388:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 202 00000100:00100000:0.0:1788330134.568398:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+42:11589:x1875199729425024:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330134.568422:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330134.568443:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab5bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee74 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.568866:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.568881:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.568892:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330134.568904:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788330134.569022:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab5bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee74 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.569038:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee74 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.569047:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:0.0:1788330134.569050:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788330134.569061:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacec00, rc 0) 00000100:00100000:0.0:1788330134.569174:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b593100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+44:11589:x1875199729425024:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 777us (968us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1788330134.569182:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 202 00000100:00100000:1.0:1788330134.572286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.574097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425152 00000100:00100000:3.0:1788330134.574113:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425152 00000100:00100000:3.0:1788330134.574187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:3.0:1788330134.574197:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a370850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+44:2349:x1875199729425152:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330134.574212:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330134.574237:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab5b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee6d expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.574256:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:3.0:1788330134.574260:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330134.574461:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a370850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+43:2349:x1875199729425152:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 265us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330134.574469:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:2.0:1788330134.580942:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330134.581059:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425280 00000100:00100000:1.0:1788330134.581071:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425280 00000100:00100000:1.0:1788330134.581169:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:1.0:1788330134.581179:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+6:2347:x1875199729425280:12345-192.168.202.47@tcp:1:lfs.0 00010000:00010000:1.0:1788330134.581226:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.581249:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.581290:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330134.581295:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330134.581301:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.581341:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.581357:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 6 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.581372:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875199750386304:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330134.581901:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788330134.587055:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.587156:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425408 00000100:00100000:0.0:1788330134.587169:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425408 00002000:00100000:0.0:1788330134.587228:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9546bfd9c000 x1875199729425408/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:150/0 lens 504/0 e 0 to 0 dl 1788330145 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788330134.587239:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfd9c000 with x1875199729425408 ext(0->8) 00010000:00010000:0.0:1788330134.587251:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 7 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.587267:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 7 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330134.587275:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9546bfd9c000 00000100:00100000:0.0:1788330134.587321:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:0.0:1788330134.587332:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729425408:12345-192.168.202.47@tcp:4:lfs.0 00000100:00100000:0.0:1788330134.587921:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2347:x1875199729425408:12345-192.168.202.47@tcp:4:lfs.0 Request processed in 589us (875us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788330134.587929:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00002000:00100000:0.0:1788330134.587936:0:6683:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9546bfd9c000 x1875199729425408/t4294967308(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:150/0 lens 504/448 e 0 to 0 dl 1788330145 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788330134.587944:0:6683:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9546bfd9c000 with x1875199729425408 ext(0->8) 00010000:00010000:0.0:1788330134.587950:0:6683:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 9 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.587969:0:6683:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 9 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330134.587976:0:6683:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9546bfd9c000 00000100:00100000:1.0:1788330134.590075:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6676:1875199750386304:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330134.590104:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.592586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.592923:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425536 00000100:00100000:2.0:1788330134.592935:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425536 00010000:00010000:2.0:1788330134.592979:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 9 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330134.593027:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:2.0:1788330134.593038:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2349:x1875199729425536:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330134.593072:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788330134.593092:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788330134.593096:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788330134 00002000:00010000:2.0:1788330134.593098:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788330135 00002000:00010000:2.0:1788330134.593100:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788330134 00010000:00010000:2.0:1788330134.593107:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 9 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.593122:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 9 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.593145:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1b6b6ce/0x91094de4de9ab595 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee5f expref: 9 pid: 6677 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.593162:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330134.593167:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330134.593172:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.593182:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.593222:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330134.593278:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2349:x1875199729425536:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 242us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330134.593285:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 76 00010000:00010000:1.0:1788330134.593414:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593424:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593448:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593463:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593472:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593478:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330134.593482:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593491:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593503:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.593510:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f924481a/0x91094de4de9ab5d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.593596:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b593800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729425280:12345-192.168.202.47@tcp:1:lfs.0 Request processed in 12418us (12663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330134.593604:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:0.0:1788330134.598059:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.598280:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425792 00000100:00100000:2.0:1788330134.598295:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425792 00000100:00100000:2.0:1788330134.598363:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 56 00000100:00100000:2.0:1788330134.598383:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+43:11589:x1875199729425792:12345-192.168.202.47@tcp:35:lfs.0 00000004:00010000:2.0:1788330134.598451:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee74 expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330134.599249:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:2.0:1788330134.599493:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1788330134.600113:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:2.0:1788330134.600175:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.600193:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 47 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.600202:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.600238:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 47 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.600254:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 47 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330134.601710:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b590700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875199750386432:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330134.601998:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a33699c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330134.608444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.608566:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b590700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5847:1875199750386432:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330134.608597:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.608758:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729425920 00000100:00100000:1.0:1788330134.608767:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729425920 00010000:00010000:1.0:1788330134.608818:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 48 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330134.608864:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 77 00000100:00100000:1.0:1788330134.608876:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+48:2346:x1875199729425920:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330134.608895:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330134.608902:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 48 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.608915:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 48 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.608940:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab580 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee51 expref: 48 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.608956:0:8437:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:1.0:1788330134.608962:0:8437:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.608973:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.608981:0:8437:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330134.609005:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330134.609095:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.609108:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330134.609249:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788330134.609462:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788330134.609606:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750386560:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788330134.609658:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330134.609699:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330134.610441:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b590000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+49:2346:x1875199729425920:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 1561us (2005us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330134.610453:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 77 00000100:00100000:1.0:1788330134.610489:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750386560 00000100:00100000:1.0:1788330134.610507:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750386560 00000100:00100000:1.0:1788330134.610955:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330134.610965:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875199750386560:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788330134.611079:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875199750386560:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330134.611087:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788330134.613028:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788330134.613056:0:5847:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788330134.613077:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469b4f1880, transno 4294967307 00000100:00100000:2.0:1788330134.613104:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750386560:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788330134.616211:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788330134.617169:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b593480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750386688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788330134.617247:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330134.617709:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a5f28840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330134.617991:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750386688 00000100:00100000:0.0:1788330134.618000:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750386688 00000100:00100000:0.0:1788330134.618067:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330134.618079:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875199750386688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788330134.618612:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b591c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875199750386688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 437us (1266us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788330134.618623:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330134.618886:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b593480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5847:1875199750386688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788330134.618965:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788330134.619013:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.619025:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.619033:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.619039:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.619043:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.619051:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.619067:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:3.0:1788330134.619070:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788330134.619075:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.619095:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab5db lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330134.619642:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788330134.620210:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1788330134.620224:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 389532705978ns, next at 390532702662ns, rc = 0 00000001:00080000:2.0:1788330134.620233:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788330134.620352:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff95468a2ccd00) 00010000:00010000:2.0:1788330134.620357:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788330134.620365:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee74 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330134.620876:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d54450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+50:11589:x1875199729425792:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 22501us (22825us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788330134.620887:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 56 00000020:00080000:2.0:1788330134.620893:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788330134.625086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.625184:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729426048 00000100:00100000:2.0:1788330134.625194:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729426048 00000100:00100000:2.0:1788330134.625258:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 203 00000100:00100000:2.0:1788330134.625269:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+50:11589:x1875199729426048:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330134.625495:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330134.625651:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dba00/0x91094de4de9ab5e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee7b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.625864:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dba00/0x91094de4de9ab5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee7b expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.625880:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dba00/0x91094de4de9ab5e2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee7b expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.625902:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:2.0:1788330134.625905:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330134.625908:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dba00, rc 0) 00000100:00100000:2.0:1788330134.626011:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+51:11589:x1875199729426048:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 744us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330134.626019:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 203 00000100:00100000:1.0:1788330134.631254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.631648:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729426304 00000100:00100000:0.0:1788330134.631658:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729426304 00000100:00100000:0.0:1788330134.631754:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:0.0:1788330134.631765:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+51:11589:x1875199729426304:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:0.0:1788330134.632112:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11589:x1875199729426304:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 347us (867us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788330134.632120:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 57 00000100:00100000:0.0:1788330134.751625:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.751995:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729426432 00000100:00100000:3.0:1788330134.752007:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729426432 00000100:00100000:3.0:1788330134.752070:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 204 00000100:00100000:3.0:1788330134.752082:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11599:x1875199729426432:12345-192.168.202.47@tcp:34:lfs.0 00010000:00010000:3.0:1788330134.752165:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752184:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752197:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752213:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752220:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752227:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752347:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752356:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752388:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330134.752652:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752668:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752684:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752692:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752698:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.752703:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752710:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752724:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330134.752727:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330134.752731:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752749:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab5e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752766:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752780:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752786:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752792:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.752795:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752980:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.752991:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95468a2cc900) 00010000:00010000:3.0:1788330134.752994:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330134.752997:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753004:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab5f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753024:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753030:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753035:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753040:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330134.753051:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753056:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753064:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330134.753067:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330134.753070:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.753075:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab5f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.753162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11599:x1875199729426432:12345-192.168.202.47@tcp:34:lfs.0 Request processed in 1080us (1545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330134.753171:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 204 00000100:00100000:3.0:1788330134.819628:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.819934:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729426688 00000100:00100000:0.0:1788330134.819945:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729426688 00000100:00100000:0.0:1788330134.820059:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 205 00000100:00100000:0.0:1788330134.820072:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+52:11602:x1875199729426688:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330134.820108:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330134.820131:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee82 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820205:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820220:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820231:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820246:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820254:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820259:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820418:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820427:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820445:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330134.820456:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788330134.820640:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820648:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820655:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820661:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330134.820665:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820673:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820695:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330134.820698:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330134.820703:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820709:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820722:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820728:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820734:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820749:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330134.820753:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820759:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820768:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330134.820770:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330134.820773:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820778:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab60c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820828:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab5fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 55 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820842:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 54 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.820849:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330134.820851:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330134.820854:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330134.820926:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11602:x1875199729426688:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 857us (1309us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788330134.820934:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 205 00000100:00100000:1.0:1788330134.825556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.825710:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729426816 00000100:00100000:0.0:1788330134.825733:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729426816 00000100:00100000:0.0:1788330134.825807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 206 00000100:00100000:0.0:1788330134.825821:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11602:x1875199729426816:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:0.0:1788330134.825893:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825908:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825921:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825949:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825954:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825960:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825965:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330134.825969:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825975:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.825984:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330134.825987:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330134.825991:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.826006:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.826080:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11602:x1875199729426816:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 264us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330134.826088:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 206 00000100:00100000:3.0:1788330134.829300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330134.829547:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729427072 00000100:00100000:2.0:1788330134.829557:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729427072 00000100:00100000:2.0:1788330134.829609:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 58 00000100:00100000:2.0:1788330134.829619:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+54:11602:x1875199729427072:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:2.0:1788330134.829865:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11602:x1875199729427072:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 246us (573us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788330134.829873:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 58 00000100:00100000:2.0:1788330134.912656:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.912837:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729427328 00000100:00100000:0.0:1788330134.912848:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729427328 00000100:00100000:0.0:1788330134.912912:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 207 00000100:00100000:0.0:1788330134.912923:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11612:x1875199729427328:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330134.912948:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330134.912952:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788330134.912981:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee66 expref: 55 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.913005:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330134.913012:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330134.913027:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab628 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee89 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.913134:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.913150:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 55 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.913158:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.913204:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 55 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.913218:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 55 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.913234:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750386816:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330134.913335:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330134.918042:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750386816:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330134.918075:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330134.918210:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.918294:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729427456 00000100:00100000:3.0:1788330134.918303:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729427456 00010000:00010000:3.0:1788330134.918350:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 56 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.918394:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 78 00000100:00100000:3.0:1788330134.918404:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+56:2347:x1875199729427456:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330134.918419:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330134.918427:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 56 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.918458:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 56 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.918481:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee82 expref: 56 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.918495:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330134.918499:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.918505:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.918510:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.918556:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330134.918603:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b591f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:2347:x1875199729427456:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 201us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330134.918609:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 78 00010000:00010000:2.0:1788330134.918900:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.918909:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330134.918956:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788330134.919125:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab628 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.919140:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330134.919148:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:2.0:1788330134.919151:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330134.919154:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacec00, rc 0) 00000100:00100000:2.0:1788330134.919195:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b590380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11612:x1875199729427328:12345-192.168.202.47@tcp:101:bash.0 Request processed in 6275us (6550us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788330134.919202:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 207 00000100:00100000:2.0:1788330134.923552:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.923885:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729427712 00000100:00100000:0.0:1788330134.923896:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729427712 00000100:00100000:0.0:1788330134.923952:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 208 00000100:00100000:0.0:1788330134.923962:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+55:11612:x1875199729427712:12345-192.168.202.47@tcp:36:bash.0 00010000:00010000:0.0:1788330134.924239:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.924257:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.924270:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330134.924318:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788330134.924341:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000643ed8c9 reply state 00000000ace16a77 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.924363:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788330134.924469:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b590e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11612:x1875199729427712:12345-192.168.202.47@tcp:36:bash.0 Request processed in 508us (953us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788330134.924478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 208 00000020:00080000:0.0:1788330134.924483:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788330134.926702:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.926720:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.926728:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.926734:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330134.926740:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.926747:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.926941:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330134.926945:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330134.926950:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.926956:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab63d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.929636:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330134.929886:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729427840 00000100:00100000:0.0:1788330134.929912:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729427840 00000100:00100000:0.0:1788330134.929977:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 209 00000100:00100000:0.0:1788330134.929986:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11612:x1875199729427840:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:0.0:1788330134.930173:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330134.930195:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee90 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.930298:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.930312:0:10120:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.930333:0:10120:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.930367:0:10120:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.930381:0:10120:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 58 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.930395:0:10120:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750386944:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330134.930487:0:10120:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330134.933978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.934062:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729427968 00000100:00100000:3.0:1788330134.934072:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729427968 00010000:00010000:3.0:1788330134.934111:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 59 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330134.934151:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:3.0:1788330134.934172:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+59:2346:x1875199729427968:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330134.934203:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330134.934212:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 59 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.934226:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 59 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.934249:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330134.934255:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.934278:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.934286:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330134.934306:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330134.934366:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+59:2346:x1875199729427968:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 196us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330134.934374:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 79 00010000:00010000:0.0:1788330134.935567:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab62f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee89 expref: 58 pid: 5844 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330134.935586:0:10120:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b8b7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10120:1875199750386944:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330134.935623:0:10120:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.935632:0:10120:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.935638:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330134.935701:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788330134.935706:0:10120:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330134.935728:0:10120:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.935771:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 58 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.935786:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 57 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330134.935795:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330134.935798:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788330134.935801:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf400, rc 0) 00000100:00100000:0.0:1788330134.935860:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469dbd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11612:x1875199729427840:12345-192.168.202.47@tcp:101:bash.0 Request processed in 5874us (6233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330134.935867:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 209 00000100:00100000:1.0:1788330134.938928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330134.939104:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729428224 00000100:00100000:3.0:1788330134.939113:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729428224 00000100:00100000:3.0:1788330134.939170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:3.0:1788330134.939181:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+57:11612:x1875199729428224:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:3.0:1788330134.940234:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11612:x1875199729428224:12345-192.168.202.47@tcp:35:bash.0 Request processed in 1049us (1310us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788330134.940244:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 59 00000100:00100000:3.0:1788330135.020436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.020697:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729428352 00000100:00100000:0.0:1788330135.020707:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729428352 00000100:00100000:0.0:1788330135.020807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 210 00000100:00100000:0.0:1788330135.020818:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+58:11619:x1875199729428352:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:0.0:1788330135.020859:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330135.020882:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab652 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee97 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.020950:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.020965:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.020977:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330135.021011:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788330135.021015:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330135.021035:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.021059:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab652 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee97 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.021078:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee97 expref: 59 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.021087:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330135.021089:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330135.021093:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacec00, rc 0) 00000100:00100000:0.0:1788330135.021155:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729428352:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 339us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.021162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 210 00000100:00080000:2.0:1788330135.021447:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330135.025331:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330135.025415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729428480 00000100:00100000:3.0:1788330135.025427:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729428480 00000100:00100000:3.0:1788330135.025488:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 211 00000100:00100000:3.0:1788330135.025499:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729428480:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330135.025553:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330135.025577:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ee9e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025697:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025717:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025730:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025746:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025753:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025765:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025863:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025893:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330135.025931:0:5844:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788330135.025935:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330135.025952:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025964:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025972:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025979:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025985:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.025990:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330135.025995:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026002:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026405:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330135.026410:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330135.026415:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026434:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026454:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026460:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026466:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026472:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330135.026475:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026482:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026491:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff95468a2cc900) 00010000:00010000:3.0:1788330135.026494:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330135.026497:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026503:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026758:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee9e expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026773:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee9e expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.026789:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330135.026791:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330135.026794:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8a00, rc 0) 00000100:00100000:3.0:1788330135.026916:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11619:x1875199729428480:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1417us (1595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330135.026923:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 211 00000100:00100000:1.0:1788330135.038901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330135.038958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330135.039113:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729428608 00000100:00100000:3.0:1788330135.039124:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729428608 00000100:00100000:3.0:1788330135.039193:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:3.0:1788330135.039205:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+60:2348:x1875199729428608:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330135.039221:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330135.039246:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab675 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee9e expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.039347:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330135.039354:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330135.039513:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+59:2348:x1875199729428608:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 309us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330135.039546:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:2.0:1788330135.041080:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729428864 00000100:00100000:2.0:1788330135.041093:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729428864 00000100:00100000:2.0:1788330135.041153:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 212 00000100:00100000:2.0:1788330135.041162:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729428864:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330135.041178:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330135.041194:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db000/0x91094de4de9ab67c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eea5 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.041286:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.041296:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 60 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.041620:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.041652:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 60 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.041662:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 60 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330135.041683:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b593b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750387072:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330135.041776:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788330135.045899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330135.046012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729428992 00000100:00100000:3.0:1788330135.046023:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729428992 00010000:00010000:3.0:1788330135.046067:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 61 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330135.046120:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 80 00000100:00100000:3.0:1788330135.046130:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+61:2347:x1875199729428992:12345-192.168.202.47@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1788330135.046146:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b593b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750387072:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330135.046159:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330135.046165:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 61 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.046171:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.046177:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 61 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.048225:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf400/0x91094de4de9ab64b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee90 expref: 61 pid: 10120 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.048249:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330135.048254:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.048265:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.048272:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.048732:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330135.048807:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:2347:x1875199729428992:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 2676us (2919us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330135.048818:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 80 00010000:00010000:2.0:1788330135.048891:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.048897:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330135.049051:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788330135.050841:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db000/0x91094de4de9ab67c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.050872:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.051418:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:2.0:1788330135.051422:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788330135.051426:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dae00, rc 0) 00000100:00100000:2.0:1788330135.051644:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11619:x1875199729428864:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 10480us (12683us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788330135.051653:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 212 00000100:00100000:3.0:1788330135.060080:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.060128:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729429248 00000100:00100000:0.0:1788330135.060138:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729429248 00000100:00100000:0.0:1788330135.060203:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:0.0:1788330135.060214:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a373850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11619:x1875199729429248:12345-192.168.202.47@tcp:103:lfs.0 00010000:00010000:0.0:1788330135.060231:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330135.060257:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dba00/0x91094de4de9ab5e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee7b expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.060285:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330135.060290:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330135.060353:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a373850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729429248:12345-192.168.202.47@tcp:103:lfs.0 Request processed in 140us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.060361:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:2.0:1788330135.065082:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.065154:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729429376 00000100:00100000:0.0:1788330135.065164:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729429376 00000100:00100000:0.0:1788330135.065230:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 213 00000100:00100000:0.0:1788330135.065240:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729429376:12345-192.168.202.47@tcp:58:lfs.0 00010000:00010000:0.0:1788330135.065369:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.065386:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.065398:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330135.065711:0:10120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788330135.065811:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b593b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729429376:12345-192.168.202.47@tcp:58:lfs.0 Request processed in 571us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.065828:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 213 00000100:00100000:2.0:1788330135.067600:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330135.067802:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729429504 00000100:00100000:1.0:1788330135.067812:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729429504 00000100:00100000:1.0:1788330135.067868:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 214 00000100:00100000:1.0:1788330135.067879:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+59:11619:x1875199729429504:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330135.067897:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330135.067916:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eeac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.067968:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.067980:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.067999:0:5846:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.068026:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.068040:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:1.0:1788330135.068043:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788330135.068047:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.068056:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509e00, rc 0) 00000100:00100000:1.0:1788330135.068157:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b592a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11619:x1875199729429504:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 280us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330135.068165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 214 00010000:00010000:2.0:1788330135.327330:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330135.878203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330135.878244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330135.878329:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.878347:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729429760 00000100:00100000:0.0:1788330135.878358:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729429760 00000100:00100000:2.0:1788330135.878371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330135.878408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729429632 00000100:00100000:3.0:1788330135.878412:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729429632 00000100:00100000:3.0:1788330135.878463:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 301 00000100:00100000:0.0:1788330135.878463:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 161 00000100:00100000:3.0:1788330135.878472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729429632:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330135.878472:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+60:2348:x1875199729429760:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330135.878624:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b592300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+60:2348:x1875199729429760:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 152us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.878631:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 161 00000100:00100000:3.0:1788330135.882449:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2348:x1875199729429632:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 3960us (4102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330135.882466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 301 00000100:00100000:1.0:1788330135.883168:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729430016 00000100:00100000:1.0:1788330135.883178:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729430016 00000100:00080000:1.0:1788330135.883208:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330135.883261:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729429888 00000100:00100000:1.0:1788330135.883265:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729429888 00000100:00100000:1.0:1788330135.883289:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:1.0:1788330135.883298:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2348:x1875199729430016:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330135.883357:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b591880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2348:x1875199729430016:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 60us (5111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.884458:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.884495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729430144 00000100:00100000:0.0:1788330135.884501:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729430144 00000100:00100000:0.0:1788330135.884571:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 162 00000100:00100000:0.0:1788330135.884580:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729430144:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330135.884623:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+5:2348:x1875199729430144:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.884631:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 162 00000100:00080000:0.0:1788330135.884653:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330135.886556:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:0.0:1788330135.886576:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2348:x1875199729429888:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330135.886645:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b592d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2348:x1875199729429888:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 77us (8283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.886654:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:1.0:1788330135.889782:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 85 00000040:00080000:3.0:1788330135.903132:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330135.903142:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330135.903201:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788330135.903211:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330135.903336:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b78d9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750387200:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788330135.903456:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b5b0840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330135.906792:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b78d9c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750387200:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788330135.910814:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.910917:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729430272 00000100:00100000:0.0:1788330135.910928:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729430272 00000100:00100000:0.0:1788330135.910987:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 215 00000100:00100000:0.0:1788330135.911014:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11620:x1875199729430272:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330135.911051:0:10120:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330135.911179:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b590a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11620:x1875199729430272:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 166us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.911187:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 215 00000100:00100000:0.0:1788330135.913646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330135.914043:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729430400 00000100:00100000:1.0:1788330135.914055:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729430400 00000100:00100000:1.0:1788330135.914116:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 216 00000100:00100000:1.0:1788330135.914124:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11620:x1875199729430400:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788330135.914212:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914229:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914241:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914255:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914262:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914268:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914291:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914300:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.914307:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330135.914350:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788330135.914354:0:5846:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330135.915369:0:5846:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915385:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915403:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915410:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915416:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330135.915421:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915428:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915441:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:1.0:1788330135.915444:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330135.915448:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915453:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9ab69f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915468:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915473:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915478:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915483:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330135.915491:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915497:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915504:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff954689d7fd00) 00010000:00010000:1.0:1788330135.915507:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330135.915509:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915514:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509000/0x91094de4de9ab6a6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915567:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915573:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915578:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915584:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330135.915587:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915593:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915600:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:1.0:1788330135.915602:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330135.915619:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.915627:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330135.915752:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11620:x1875199729430400:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 Request processed in 1623us (2111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330135.915761:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 216 00000100:00100000:2.0:1788330135.920895:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.921024:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729430656 00000100:00100000:0.0:1788330135.921036:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729430656 00000100:00100000:0.0:1788330135.921097:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 217 00000100:00100000:0.0:1788330135.921107:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+60:11620:x1875199729430656:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330135.921128:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330135.921149:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6b4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eeb3 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921248:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921264:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921276:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330135.921287:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788330135.921401:0:10120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921409:0:10120:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921435:0:10120:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921440:0:10120:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330135.921444:0:10120:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921452:0:10120:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921464:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330135.921467:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788330135.921471:0:10120:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921477:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921557:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6b4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeb3 expref: 62 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921568:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:0.0:1788330135.921571:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788330135.921575:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6b4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeb3 expref: 62 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.921584:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface400, rc 0) 00000100:00100000:0.0:1788330135.921912:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b591500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11620:x1875199729430656:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 804us (1026us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788330135.921931:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 217 00000100:00100000:3.0:1788330135.924854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.925213:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729430784 00000100:00100000:0.0:1788330135.925224:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729430784 00000100:00100000:0.0:1788330135.925279:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 218 00000100:00100000:0.0:1788330135.925290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11620:x1875199729430784:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788330135.925328:0:5845:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788330135.925437:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11620:x1875199729430784:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 149us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.925443:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 218 00000100:00100000:2.0:1788330135.931282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330135.931803:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729431040 00000100:00100000:3.0:1788330135.931814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729431040 00000100:00100000:2.0:1788330135.931950:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 219 00000100:00100000:2.0:1788330135.931960:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11620:x1875199729431040:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330135.931982:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330135.931984:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788330135.932010:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacec00/0x91094de4de9ab659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee97 expref: 61 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.932029:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330135.932034:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330135.932061:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab6c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eeba expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788330135.932920:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788330135.933116:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.933130:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.933139:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.933209:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab6c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeba expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.933226:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeba expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330135.933234:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff954692606100) 00010000:00010000:2.0:1788330135.933237:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330135.933239:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2daa00, rc 0) 00000100:00100000:2.0:1788330135.933314:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b592680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11620:x1875199729431040:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1355us (2044us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788330135.933323:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 219 00000100:00100000:3.0:1788330135.936791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.937082:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729431296 00000100:00100000:0.0:1788330135.937092:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729431296 00000100:00100000:0.0:1788330135.937145:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 220 00000100:00100000:0.0:1788330135.937156:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11620:x1875199729431296:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788330135.937215:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330135.937240:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeba expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937259:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff954692606100) 00010000:00010000:0.0:1788330135.937269:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330135.937290:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937304:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937313:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937351:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937488:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937496:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937580:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937588:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937594:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937599:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330135.937603:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937773:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937783:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:0.0:1788330135.937786:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330135.937790:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937796:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface400/0x91094de4de9ab6de lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937815:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937821:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937828:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937834:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330135.937837:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937842:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937850:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x334011ae (ffff9546a5cd6f00) 00010000:00010000:0.0:1788330135.937852:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330135.937855:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.937860:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface800/0x91094de4de9ab6e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x334011ae bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330135.937948:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11620:x1875199729431296:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 792us (1166us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788330135.937956:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 220 00000100:00100000:3.0:1788330135.941289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.941631:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729431424 00000100:00100000:0.0:1788330135.941641:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729431424 00000100:00100000:0.0:1788330135.941713:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 221 00000100:00100000:0.0:1788330135.941737:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+61:11620:x1875199729431424:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330135.941758:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330135.941779:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab6ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eec1 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.941816:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.941829:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.941839:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.941931:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab6ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 63 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.941949:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 62 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.941958:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330135.941960:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788330135.941963:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface200, rc 0) 00000100:00100000:0.0:1788330135.942028:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11620:x1875199729431424:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 292us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.942035:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 221 00000100:00100000:2.0:1788330135.945598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330135.945965:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729431680 00000100:00100000:1.0:1788330135.945976:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729431680 00000100:00100000:1.0:1788330135.946037:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 222 00000100:00100000:1.0:1788330135.946049:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+62:11620:x1875199729431680:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788330135.946135:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.946151:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.946162:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330135.946433:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788330135.946443:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 390858924521ns, next at 391858922311ns, rc = 0 00000004:00010000:1.0:1788330135.946559:0:5846:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004e7b475d reply state 00000000aa0514cb transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330135.946568:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788330135.946911:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b591180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+64:11620:x1875199729431680:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 861us (1319us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788330135.946938:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 222 00000100:00100000:2.0:1788330135.951865:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:3.0:1788330135.951967:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.951981:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.951988:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.951993:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330135.951998:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.952020:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.952036:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:3.0:1788330135.952039:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788330135.952043:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.952049:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9ab6fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330135.952435:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729431808 00000100:00100000:0.0:1788330135.952448:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729431808 00000100:00100000:0.0:1788330135.952818:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 223 00000100:00100000:0.0:1788330135.952837:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+63:11620:x1875199729431808:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330135.952863:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330135.952883:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eec8 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.952947:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 64 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.952961:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 64 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330135.952983:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330135.952986:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330135.952989:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330135.953055:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b590000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+64:11620:x1875199729431808:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 219us (1199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330135.953061:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 223 00000100:00100000:2.0:1788330135.958660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.959295:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729431936 00000100:00100000:0.0:1788330135.959308:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729431936 00000100:00100000:0.0:1788330135.959440:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:0.0:1788330135.959453:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729431936:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788330135.960230:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b591f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2346:x1875199729431936:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 776us (1577us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1788330135.960255:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:3.0:1788330135.970855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.970971:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729432192 00000100:00100000:0.0:1788330135.970982:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729432192 00000100:00100000:0.0:1788330135.971095:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:0.0:1788330135.971106:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b78d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+64:11620:x1875199729432192:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788330135.971411:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b78d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+65:11620:x1875199729432192:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 306us (566us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788330135.971420:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 60 00000100:00100000:2.0:1788330135.978262:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330135.978487:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729432448 00000100:00100000:0.0:1788330135.978497:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729432448 00000100:00100000:1.0:1788330135.978876:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 224 00000100:00100000:1.0:1788330135.978889:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+65:11620:x1875199729432448:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330135.979053:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b590700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+65:11620:x1875199729432448:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 166us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330135.979062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 224 00000100:00100000:2.0:1788330135.984005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330135.984161:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729432576 00000100:00100000:3.0:1788330135.984171:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729432576 00000100:00100000:3.0:1788330135.984294:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 225 00000100:00100000:3.0:1788330135.984305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+65:11620:x1875199729432576:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330135.984326:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330135.984346:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab708 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eecf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.984426:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab70f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.984441:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab70f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.984451:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab70f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330135.984488:0:5844:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330135.984562:0:5844:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab70f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.984604:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab708 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eecf expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.984624:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab70f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eecf expref: 66 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330135.984632:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:3.0:1788330135.984635:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788330135.984638:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9a00, rc 0) 00000100:00100000:3.0:1788330135.984706:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf4f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+66:11620:x1875199729432576:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 403us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330135.984721:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 225 00000100:00100000:0.0:1788330135.991366:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330135.991470:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729432704 00000100:00100000:1.0:1788330135.991480:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729432704 00000100:00100000:1.0:1788330135.991567:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:1.0:1788330135.991597:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfa8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+10:2347:x1875199729432704:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330135.991616:0:8194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330135.991638:0:8194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eed6 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788330135.991676:0:8194:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c098, blocks: 0x1 00010000:00010000:1.0:1788330135.991699:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=390s v=(0 0) 00010000:00010000:1.0:1788330135.991704:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330135.991947:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 11 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.991969:0:8194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 11 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330135.991985:0:8194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509000, rc 0) 00000100:00100000:1.0:1788330135.992064:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfa8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+11:2347:x1875199729432704:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 487us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330135.992071:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:2.0:1788330136.007089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330136.007345:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729432960 00000100:00100000:1.0:1788330136.007369:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729432960 00000100:00100000:1.0:1788330136.007441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 226 00000100:00100000:1.0:1788330136.007452:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+66:11620:x1875199729432960:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788330136.007869:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+66:11620:x1875199729432960:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 416us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.007877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 226 00000100:00100000:0.0:1788330136.028083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330136.028283:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433088 00000100:00100000:1.0:1788330136.028293:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433088 00000100:00100000:1.0:1788330136.028391:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 67 00000100:00100000:1.0:1788330136.028402:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+11:11620:x1875199729433088:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330136.028421:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330136.028440:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eedd expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.028474:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.028484:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330136.028488:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330136.028494:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.028609:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.028631:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330136.028644:0:6676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875199750387328:192.168.202.47@tcp:104: 00000100:00100000:1.0:1788330136.028810:0:6676:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330136.035355:0:6676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6676:1875199750387328:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330136.035391:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 12 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.035412:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509600, rc 0) 00000100:00100000:1.0:1788330136.035474:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+12:11620:x1875199729433088:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 7073us (7400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.035483:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 67 00000100:00100000:2.0:1788330136.036987:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330136.037078:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433216 00000100:00100000:1.0:1788330136.037090:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433216 00010000:00010000:1.0:1788330136.037130:0:8437:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330136.037251:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:1.0:1788330136.037262:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+12:2347:x1875199729433216:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330136.037296:0:8437:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330136.037319:0:8437:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.037335:0:8437:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.037359:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f924481a/0x91094de4de9ab716 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eed6 expref: 12 pid: 8194 timeout: 490 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.037376:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330136.037381:0:8437:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330136.037390:0:8437:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.037399:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.037439:0:8437:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 11 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330136.037454:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8437:1875199750387456:192.168.202.47@tcp:105: 00000100:00100000:1.0:1788330136.038294:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330136.043975:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8437:1875199750387456:192.168.202.47@tcp:105: 00010000:00010000:1.0:1788330136.044005:0:8437:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330136.044100:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+11:2347:x1875199729433216:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 6837us (7118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.044112:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:0.0:1788330136.047034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330136.047336:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433344 00000100:00100000:3.0:1788330136.047347:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433344 00002000:00100000:3.0:1788330136.047411:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff95469b8b6d80 x1875199729433344/t0(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:152/0 lens 504/0 e 0 to 0 dl 1788330147 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330136.047422:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95469b8b6d80 with x1875199729433344 ext(0->12) 00002000:00010000:3.0:1788330136.047428:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95469b8b6d80 00000100:00100000:3.0:1788330136.047460:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330136.047471:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+11:2346:x1875199729433344:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788330136.049042:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2346:x1875199729433344:12345-192.168.202.47@tcp:4:lhsmtool_posix.0 Request processed in 1564us (2008us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788330136.049058:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00002000:00100000:3.0:1788330136.049070:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff95469b8b6d80 x1875199729433344/t4294967320(0) o4->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:152/0 lens 504/448 e 0 to 0 dl 1788330147 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330136.049089:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95469b8b6d80 with x1875199729433344 ext(0->12) 00002000:00010000:3.0:1788330136.049095:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95469b8b6d80 00000100:00100000:3.0:1788330136.052966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.053114:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433472 00000100:00100000:0.0:1788330136.053125:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433472 00000100:00100000:0.0:1788330136.053191:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 227 00000100:00100000:0.0:1788330136.053202:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+66:11620:x1875199729433472:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788330136.114028:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788330136.114073:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:3.0:1788330136.114106:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9546a3369c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788330136.114112:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95469dcb4200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9546a33693c0 00000020:00080000:3.0:1788330136.114115:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff95469dcb4f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95469b8fd000 00000020:00080000:3.0:1788330136.114157:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9546a3369840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788330136.114160:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff954688e87b00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9546a3369900 00000020:00080000:3.0:1788330136.114162:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff954688e87a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95469b4e5800 00000004:00080000:3.0:1788330136.114177:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788330136.114195:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:3.0:1788330136.114218:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1788330136.114231:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:2.0:1788330136.114907:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750387712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788330136.114979:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330136.115039:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330136.115045:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750387584:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788330136.115065:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330136.115094:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750387712 00000100:00100000:2.0:1788330136.115101:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750387712 00000100:00100000:2.0:1788330136.115143:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750387584 00000100:00100000:2.0:1788330136.115146:0:6677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750387584 00000100:00100000:2.0:1788330136.115166:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788330136.115175:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750387712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788330136.115312:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788330136.115316:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788330136 00002000:00010000:2.0:1788330136.115318:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788330136.115320:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788330136 -> 1788330136 00002000:00010000:2.0:1788330136.115322:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:3.0:1788330136.115951:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788330136.116011:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b588380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1875199750387712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 187us (381us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1788330136.116021:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1788330136.116070:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469b589500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1788330136.116076:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b589500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750387712:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788330136.116095:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788330136.116105:0:6677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750387584:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788330136.116125:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1788330136.116158:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.116181:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.116192:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788330136.116197:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330136.116203:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.116233:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 12 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.116249:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 12 pid: 6678 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.116262:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875199750387840:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330136.116343:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4000 going to sleep for 11 seconds 00000100:00080000:0.0:1788330136.116758:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330136.116771:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330136.116783:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750387968:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788330136.116818:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330136.116848:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750387968 00000100:00100000:0.0:1788330136.116853:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750387968 00000100:00100000:0.0:1788330136.116888:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788330136.116895:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750387968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788330136.116909:0:6678:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:0.0:1788330136.116934:0:6678:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a97c096, atime: 0x6a97c097, ctime: 0x6a97c096, blocks: 0x1 00010000:00010000:0.0:1788330136.116941:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.116965:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1788330136.116968:0:6678:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330136.116974:0:6678:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.116990:0:6678:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117000:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117008:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117026:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330136.117588:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3315:x1875199750387968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 692us (767us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788330136.117597:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1788330136.117622:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330136.117628:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117637:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfc00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330136.117641:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117676:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117695:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117702:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9ab72b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.117719:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330136.117721:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330136.117723:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330136.117730:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788330136.117756:0:3315:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff95469b8b4a80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788330136.117761:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b8b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750387968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788330136.123997:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6677:1875199750387840:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330136.124031:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330136.127445:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330136.127563:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433600 00000100:00100000:1.0:1788330136.127577:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433600 00010000:00010000:1.0:1788330136.127625:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 13 pid: 6678 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330136.127692:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 82 00000100:00100000:1.0:1788330136.127704:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+13:2346:x1875199729433600:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330136.127721:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330136.127729:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 13 pid: 6678 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.127754:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 13 pid: 6678 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.127780:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b84c7a63/0x91094de4de9ab4e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee3c expref: 13 pid: 6678 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.127798:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330136.127803:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788330136.127808:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.127818:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.127871:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330136.127927:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+12:2346:x1875199729433600:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 225us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.127935:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 82 00010000:00010000:2.0:1788330136.128313:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.128349:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.128359:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.128367:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.128394:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788330136.129044:0:6677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3313:x1875199750387584:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12939us (13974us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788330136.129054:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000004:00080000:2.0:1788330136.129107:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9546bfdb2a00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788330136.129114:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfdb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750387584:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788330136.131104:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330136.131118:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.131131:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2db600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330136.131136:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.131146:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.131169:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.131176:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5fab2ec/0x91094de4de9ab724 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.131203:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330136.131204:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330136.131207:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330136.133339:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11620:x1875199729433472:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 Request processed in 80122us (80368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.133357:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 227 00000100:00100000:3.0:1788330136.136698:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.136866:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433728 00000100:00100000:0.0:1788330136.136876:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433728 00000100:00100000:0.0:1788330136.136968:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 71 00000100:00100000:0.0:1788330136.136978:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+12:2349:x1875199729433728:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788330136.207396:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+12:2349:x1875199729433728:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 Request processed in 70408us (70698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.207411:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 71 00000001:00080000:2.0:1788330136.208974:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1788330136.209001:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:2.0:1788330136.209008:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1788330136.209017:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:0.0:1788330136.216475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.216675:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729433984 00000100:00100000:2.0:1788330136.216686:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729433984 00000100:00100000:2.0:1788330136.216752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 228 00000100:00100000:2.0:1788330136.216778:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11620:x1875199729433984:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788330136.216836:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330136.216864:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9a00/0x91094de4de9ab70f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eecf expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.216885:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330136.216890:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330136.216920:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.216933:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.216942:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330136.217181:0:5845:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000022a5569a reply state 0000000010fe9215 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.217190:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330136.217285:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+21:11620:x1875199729433984:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 509us (820us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788330136.217293:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 228 00010000:00010000:0.0:1788330136.220849:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.220891:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.220899:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.220904:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330136.220909:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.220916:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.220933:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330136.220936:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788330136.220940:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.220947:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330136.223043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330136.223142:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729434112 00000100:00100000:1.0:1788330136.223152:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729434112 00000100:00100000:1.0:1788330136.223224:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:1.0:1788330136.223235:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729434112:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788330136.223565:0:6676:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788330136.223569:0:6676:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788330136 -> 1788330135 00002000:00010000:1.0:1788330136.223572:0:6676:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788330135 00002000:00010000:1.0:1788330136.223574:0:6676:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788330136 -> 1788330135 00002000:00010000:1.0:1788330136.223577:0:6676:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788330136.223772:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729434112:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 538us (738us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1788330136.223782:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 72 00000100:00100000:3.0:1788330136.226968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.227225:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729434368 00000100:00100000:2.0:1788330136.227241:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729434368 00000100:00100000:2.0:1788330136.227327:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 229 00000100:00100000:2.0:1788330136.227341:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11620:x1875199729434368:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788330136.227453:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.227492:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 20 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.227501:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.227587:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 20 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.227611:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 20 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.227629:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750388096:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330136.227772:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330136.230583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.230688:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729434496 00000100:00100000:0.0:1788330136.230699:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729434496 00010000:00010000:0.0:1788330136.230738:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330136.230783:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 83 00000100:00100000:0.0:1788330136.230793:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+21:2347:x1875199729434496:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330136.230828:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330136.230836:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.230849:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.230871:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330136.230877:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.230886:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.230894:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.230914:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330136.230971:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+21:2347:x1875199729434496:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 178us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.230978:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 83 00010000:00010000:2.0:1788330136.232382:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9ab6f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec1 expref: 20 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.232404:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5844:1875199750388096:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330136.232431:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232441:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232447:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232476:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232497:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232504:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232509:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dbe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330136.232514:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232572:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232586:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:2.0:1788330136.232589:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788330136.232593:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.232600:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9ab739 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.232658:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11620:x1875199729434368:12345-192.168.202.47@tcp:55:lhsmtool_posix.0 Request processed in 5320us (5700us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788330136.232677:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 229 00000100:00100000:1.0:1788330136.239986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.240094:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729434624 00000100:00100000:0.0:1788330136.240108:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729434624 00000100:00100000:0.0:1788330136.240174:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:0.0:1788330136.240185:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729434624:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788330136.240235:0:8194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.243698:0:8194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.243715:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788330136.243720:0:8194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788330136.243725:0:8194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.243779:0:8194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.243798:0:8194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 8 pid: 6676 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330136.243815:0:8194:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8194:1875199750388224:192.168.202.47@tcp:104: 00000100:00100000:0.0:1788330136.244023:0:8194:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a86c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330136.252467:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.252553:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729434752 00000100:00100000:2.0:1788330136.252564:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729434752 00010000:00010000:2.0:1788330136.252605:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 9 pid: 6676 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.252645:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 84 00000100:00100000:2.0:1788330136.252681:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+9:2346:x1875199729434752:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330136.252696:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330136.252720:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 9 pid: 6676 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.252736:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 9 pid: 6676 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.252760:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330136.252765:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788330136.252772:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.252783:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.252803:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788330136.253126:0:8194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9ab71d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eedd expref: 9 pid: 6676 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330136.253142:0:8194:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b8b4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8194:1875199750388224:192.168.202.47@tcp:104: 00010000:00010000:0.0:1788330136.253162:0:8194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253173:0:8194:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253190:0:8194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253216:0:8194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253225:0:8194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253233:0:8194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253241:0:8194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330136.253246:0:8194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253267:0:8194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253281:0:8194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.253289:0:8194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab740 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.253992:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729434752:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 1310us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.254002:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 84 00000100:00100000:0.0:1788330136.254600:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729434624:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 Request processed in 14413us (14622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.254610:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 73 00000100:00100000:3.0:1788330136.257821:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.258206:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729435008 00000100:00100000:2.0:1788330136.258217:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729435008 00000100:00100000:2.0:1788330136.258291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 230 00000100:00100000:2.0:1788330136.258302:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11620:x1875199729435008:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788330136.258797:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.258833:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.258846:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.259053:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.259066:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 20 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.259075:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.259111:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 20 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.259126:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 20 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.259140:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750388352:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330136.259273:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330136.263873:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750388352:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330136.263910:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330136.266094:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.266291:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729435136 00000100:00100000:0.0:1788330136.266303:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729435136 00010000:00010000:0.0:1788330136.266349:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330136.266418:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:0.0:1788330136.266429:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+21:2347:x1875199729435136:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330136.266444:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330136.266452:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.266468:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.266492:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab701 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eec8 expref: 21 pid: 10120 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.266509:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:0.0:1788330136.266514:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.266547:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.266572:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.266599:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330136.266673:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+20:2347:x1875199729435136:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 237us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.266681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 85 00010000:00010000:3.0:1788330136.267879:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.267893:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330136.268084:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788330136.268243:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788330136.268292:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788330136.269214:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875199750388480:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788330136.269296:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330136.269334:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788330136.269492:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750388480 00000100:00100000:0.0:1788330136.269499:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750388480 00000100:00100000:0.0:1788330136.269573:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330136.269582:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875199750388480:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788330136.269660:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875199750388480:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.269676:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788330136.269872:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1788330136.269878:0:5845:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1788330136.269899:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469b589500, transno 4294967321 00000004:00080000:3.0:1788330136.269918:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9546bfdb2a00, transno 4294967322 00000100:00100000:3.0:1788330136.269925:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875199750388480:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788330136.270821:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788330136.270917:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875199750388608:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788330136.270961:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330136.271057:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a3369cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330136.272715:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750388608 00000100:00100000:1.0:1788330136.272729:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750388608 00000100:00100000:1.0:1788330136.272787:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330136.272798:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875199750388608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788330136.273107:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875199750388608:12345-0@lo:1000:mdt00_001.0 Request processed in 311us (2144us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788330136.273116:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330136.276197:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5845:1875199750388608:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788330136.276271:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.276283:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.276309:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.276328:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2db600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330136.276333:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.276341:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280570:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9546a5cd6c00) 00010000:00010000:3.0:1788330136.280583:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330136.280595:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280606:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db600/0x91094de4de9ab74e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280655:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280675:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280683:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280690:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330136.280694:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280723:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330136.280740:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330136.280749:0:5845:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280760:0:5845:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280769:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.280817:0:5845:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330136.280832:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750388736:192.168.202.47@tcp:105: 00000100:00100000:3.0:1788330136.280925:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330136.285188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330136.285484:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729435264 00000100:00100000:1.0:1788330136.285494:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729435264 00000100:00100000:1.0:1788330136.285589:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:1.0:1788330136.285610:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11619:x1875199729435264:12345-192.168.202.47@tcp:49:lfs.0 00000100:00100000:1.0:1788330136.285767:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11619:x1875199729435264:12345-192.168.202.47@tcp:49:lfs.0 Request processed in 168us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.285777:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 61 00000100:00100000:1.0:1788330136.289281:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.289605:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729435520 00000100:00100000:2.0:1788330136.289616:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729435520 00000100:00100000:2.0:1788330136.289698:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 231 00000100:00100000:2.0:1788330136.289710:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11619:x1875199729435520:12345-192.168.202.47@tcp:58:lfs.0 00000040:00080000:2.0:1788330136.290119:0:10120:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788330136.297159:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+24:11619:x1875199729435520:12345-192.168.202.47@tcp:58:lfs.0 Request processed in 7435us (7872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.297177:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 231 00000100:00100000:0.0:1788330136.300456:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750388736:192.168.202.47@tcp:105: 00010000:00010000:0.0:1788330136.300492:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.300503:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab691 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300762:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300779:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300791:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300802:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300809:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300816:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300822:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330136.300826:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300834:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300845:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:1.0:1788330136.300849:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330136.300852:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300857:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508000/0x91094de4de9ab755 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300888:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300894:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300899:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300904:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330136.300907:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300912:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300920:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:1.0:1788330136.300922:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788330136.300925:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.300931:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da800/0x91094de4de9ab747 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330136.301152:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+23:11620:x1875199729435008:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 42849us (43338us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788330136.301163:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 230 00000020:00080000:1.0:1788330136.301169:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788330136.301370:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330136.301375:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330136.301414:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788330136.301422:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330136.301564:0:11669:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be23480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750388864:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788330136.301621:0:11669:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b50a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330136.309863:0:11669:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be23480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11669:1875199750388864:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788330136.310194:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330136.310274:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729435776 00000100:00100000:3.0:1788330136.310281:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729435776 00000100:00100000:3.0:1788330136.310332:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 62 00000100:00100000:3.0:1788330136.310342:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:11620:x1875199729435776:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788330136.311000:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788330136.311107:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788330136.311159:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.311179:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.311192:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.311201:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.311208:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.311215:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330136.311240:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330136.311270:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330136.311278:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.311296:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330136.311301:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.311322:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330136.311332:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d55450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+25:11620:x1875199729435776:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 985us (1133us total) trans 4294967514 rc 0/0 00010000:00010000:0.0:1788330136.311340:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff95468a2cc200) 00000100:00100000:3.0:1788330136.311344:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 62 00010000:00010000:0.0:1788330136.311345:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000020:00080000:3.0:1788330136.311352:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788330136.311352:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.311361:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8a00/0x91094de4de9ab75c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.311394:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330136.311396:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330136.311399:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330136.316855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.318654:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729435904 00000100:00100000:2.0:1788330136.318679:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729435904 00000100:00100000:2.0:1788330136.318751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 232 00000100:00100000:2.0:1788330136.318761:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+25:11621:x1875199729435904:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788330136.318797:0:5846:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788330136.318921:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+25:11621:x1875199729435904:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 160us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.318928:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 232 00000100:00100000:2.0:1788330136.322752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.323580:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729436160 00000100:00100000:0.0:1788330136.323594:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729436160 00000100:00100000:0.0:1788330136.323671:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 233 00000100:00100000:0.0:1788330136.323684:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+25:11621:x1875199729436160:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788330136.323713:0:10120:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330136.323735:0:10120:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab763 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eee4 expref: -99 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.323846:0:10120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab76a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.323863:0:10120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.323875:0:10120:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10120 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330136.323900:0:10120:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788330136.324034:0:10120:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf800/0x91094de4de9ab763 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eee4 expref: 28 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.324052:0:10120:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab76a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eee4 expref: 27 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330136.324061:0:10120:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:0.0:1788330136.324064:0:10120:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788330136.324067:0:10120:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330136.324140:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b589500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+27:11621:x1875199729436160:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 458us (1400us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788330136.324147:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 233 00000100:00100000:1.0:1788330136.340970:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.341271:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729436416 00000100:00100000:2.0:1788330136.341284:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729436416 00000100:00100000:2.0:1788330136.341367:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 234 00000100:00100000:2.0:1788330136.341380:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+27:11621:x1875199729436416:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788330136.341476:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341495:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341508:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341761:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341769:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341790:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341796:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330136.341800:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341808:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341821:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:2.0:1788330136.341824:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330136.341829:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.341834:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab778 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.342009:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+28:11621:x1875199729436416:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 630us (1049us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788330136.342017:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 234 00000040:00080000:0.0:1788330136.342066:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330136.342072:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330136.342597:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788330136.342610:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788330136.345788:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330136.345864:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729436672 00000100:00100000:0.0:1788330136.345877:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729436672 00000100:00100000:0.0:1788330136.345996:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 63 00000100:00100000:0.0:1788330136.346009:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+28:11621:x1875199729436672:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788330136.346273:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:11621:x1875199729436672:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 265us (494us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788330136.346281:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 63 00010000:00010000:1.0:1788330136.353497:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330136.354339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330136.354572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729436800 00000100:00100000:3.0:1788330136.354599:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729436800 00000100:00100000:2.0:1788330136.354768:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 235 00000100:00100000:2.0:1788330136.354780:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+29:11623:x1875199729436800:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330136.354806:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330136.354829:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab77f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eeeb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.354902:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.354929:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.354941:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.354958:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.354966:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.354972:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.355626:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.355641:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.355651:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.355701:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.355717:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 30 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.355747:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750388992:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330136.355853:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4000 going to sleep for 11 seconds 00000100:00100000:2.0:1788330136.364721:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5845:1875199750388992:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330136.364755:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330136.372245:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330136.372412:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437056 00000100:00100000:3.0:1788330136.372423:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437056 00000100:00100000:3.0:1788330136.372489:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:3.0:1788330136.372501:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+31:5589:x1875199729437056:12345-192.168.202.47@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788330136.372794:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:5589:x1875199729437056:12345-192.168.202.47@tcp:35:ldlm_bl.0 Request processed in 295us (562us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1788330136.372802:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 64 00000100:00100000:1.0:1788330136.382621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330136.382746:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437184 00000100:00100000:2.0:1788330136.382761:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437184 00010000:00010000:2.0:1788330136.382806:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 32 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330136.382855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:2.0:1788330136.382865:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+32:2347:x1875199729437184:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330136.382882:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330136.382891:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 32 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.382906:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 32 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.382930:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dae00/0x91094de4de9ab683 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7eea5 expref: 32 pid: 5845 timeout: 491 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.382949:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:2.0:1788330136.382954:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.382980:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.382988:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330136.383029:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330136.383170:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383179:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330136.383226:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788330136.383230:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330136.383251:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383266:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383277:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383285:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383292:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383300:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330136.383304:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383327:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383338:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:1.0:1788330136.383341:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330136.383346:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383352:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da000/0x91094de4de9ab786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383364:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383387:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383393:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383398:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2da600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330136.383401:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383407:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383414:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff954692606200) 00010000:00010000:1.0:1788330136.383416:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330136.383419:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383435:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da600/0x91094de4de9ab78d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383474:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2db800/0x91094de4de9ab77f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeeb expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383488:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeeb expref: 31 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330136.383496:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:1.0:1788330136.383498:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788330136.383500:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2daa00, rc 0) 00000100:00100000:2.0:1788330136.383616:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+31:2347:x1875199729437184:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 751us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.383624:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:1.0:1788330136.386185:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+30:11623:x1875199729436800:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 31392us (31838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330136.386198:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 235 00000100:00100000:2.0:1788330136.734866:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750389376:0@lo:400:kworker.0 00000100:00100000:0.0:1788330136.734866:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750389120:0@lo:400:kworker.0 00000100:00100000:3.0:1788330136.734941:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750389504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330136.737192:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750389248:0@lo:400:kworker.0 00000100:00100000:0.0:1788330136.739337:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330136.739765:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330136.739780:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330136.739820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330136.739891:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389120 00000100:00100000:0.0:1788330136.739899:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389120 00000100:00100000:2.0:1788330136.739920:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389376 00000100:00100000:2.0:1788330136.739924:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389376 00000100:00100000:0.0:1788330136.739945:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1788330136.739953:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750389120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330136.739961:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788330136.739966:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750389376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330136.740003:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750389376:12345-0@lo:400:kworker.0 Request processed in 35us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.740003:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750389120:12345-0@lo:400:kworker.0 Request processed in 50us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.740011:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788330136.740011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788330136.740033:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389632 00000100:00100000:2.0:1788330136.740037:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389632 00000100:00100000:0.0:1788330136.740235:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469b58b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750389120:0@lo:400:kworker.0 00000100:00100000:2.0:1788330136.740634:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788330136.740655:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750389632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788330136.740684:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788330136.740729:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3315:x1875199750389632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330136.740736:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788330136.740768:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330136.740795:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750389376:0@lo:400:kworker.0 00000100:00100000:2.0:1788330136.740824:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750389632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330136.745247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330136.745349:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330136.758496:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389504 00000100:00100000:2.0:1788330136.758532:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389504 00000100:00080000:2.0:1788330136.761498:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330136.761675:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389248 00000100:00100000:0.0:1788330136.761690:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389248 00000100:00100000:0.0:1788330136.761734:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788330136.761745:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750389504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330136.761749:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788330136.761758:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750389248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330136.770809:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750389248:12345-0@lo:400:kworker.0 Request processed in 9040us (25446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330136.770809:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750389504:12345-0@lo:400:kworker.0 Request processed in 9053us (25558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330136.770828:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788330136.770831:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788330136.770981:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750389504:0@lo:400:kworker.0 00000100:00100000:1.0:1788330136.771476:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750389248:0@lo:400:kworker.0 00010000:00010000:0.0:1788330137.374779:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330137.492620:0:12611:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330137.492629:0:12611:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330137.492689:0:12611:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788330137.492697:0:12611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788330137.731633:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330137.731688:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437440 00000100:00100000:3.0:1788330137.731700:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437440 00000100:00100000:3.0:1788330137.731767:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 236 00000100:00100000:3.0:1788330137.731780:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+30:11646:x1875199729437440:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:3.0:1788330137.731811:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330137.731836:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab79b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eef2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.731973:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab7a2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.731989:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.732003:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab7a2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330137.732015:0:5846:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788330137.732144:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8200/0x91094de4de9ab79b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eef2 expref: 33 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.732167:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab7a2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eef2 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.732176:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330137.732179:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788330137.732183:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9400, rc 0) 00000100:00100000:3.0:1788330137.732262:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11646:x1875199729437440:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 468us (623us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788330137.732270:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 236 00000100:00080000:3.0:1788330137.732295:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330137.741673:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330137.742001:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437568 00000100:00100000:3.0:1788330137.742013:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437568 00000100:00100000:3.0:1788330137.742063:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 237 00000100:00100000:3.0:1788330137.742075:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11646:x1875199729437568:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:3.0:1788330137.742168:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742186:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742198:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742226:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742233:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742241:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742260:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330137.742264:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742272:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742283:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330137.742286:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330137.742291:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330137.742297:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9e00/0x91094de4de9ab7b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330137.742403:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+32:11646:x1875199729437568:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 330us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330137.742411:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 237 00000100:00100000:1.0:1788330137.875613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330137.875736:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437696 00000100:00100000:0.0:1788330137.875748:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437696 00000100:00080000:3.0:1788330137.875894:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330137.875940:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:0.0:1788330137.875953:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2347:x1875199729437696:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:0.0:1788330137.875973:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330137.875999:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab7b7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eef9 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330137.876048:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a97c097, atime: 0x6a97c097, ctime: 0x6a97c097, blocks: 0xb 00010000:00010000:0.0:1788330137.876071:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=392s v=(0 0) 00010000:00010000:0.0:1788330137.876076:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330137.876086:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab7b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eef9 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330137.876104:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab7b7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eef9 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330137.876120:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface400, rc 0) 00000100:00100000:0.0:1788330137.876186:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2347:x1875199729437696:12345-192.168.202.47@tcp:101:cat.0 Request processed in 236us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330137.876194:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:0.0:1788330137.895712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330137.899262:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437824 00000100:00100000:3.0:1788330137.899278:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437824 00002000:00100000:3.0:1788330137.899341:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff95469b8b4380 x1875199729437824/t0(0) o3->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:153/0 lens 488/0 e 0 to 0 dl 1788330148 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330137.899456:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95469b8b4380 with x1875199729437824 ext(0->4095) 00002000:00010000:3.0:1788330137.899461:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95469b8b4380 00000100:00100000:3.0:1788330137.899488:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:3.0:1788330137.899497:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729437824:12345-192.168.202.47@tcp:3:cat.0 00000100:00100000:3.0:1788330137.899739:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729437824:12345-192.168.202.47@tcp:3:cat.0 Request processed in 243us (4040us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788330137.899745:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00002000:00100000:3.0:1788330137.899750:0:6684:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff95469b8b4380 x1875199729437824/t0(0) o3->7a815e47-382d-4064-91e8-23b9de97ce7e@192.168.202.47@tcp:153/0 lens 488/4536 e 0 to 0 dl 1788330148 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788330137.899756:0:6684:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff95469b8b4380 with x1875199729437824 ext(0->4095) 00002000:00010000:3.0:1788330137.899758:0:6684:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95469b8b4380 00010000:00010000:1.0:1788330138.399024:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330138.782841:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750389760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330138.783274:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330138.783363:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389760 00000100:00100000:1.0:1788330138.783372:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389760 00000100:00100000:2.0:1788330138.783456:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788330138.783468:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750389760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330138.783552:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330138.783606:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfb7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875199750389760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330138.783614:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788330138.783660:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750389760:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788330138.786983:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788330139.387886:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:2.0:1788330139.387904:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:3.0:1788330139.428685:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330140.446693:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330140.995902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330140.995943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330140.995980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330140.996000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330140.996022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330140.996047:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729437952 00000100:00100000:0.0:1788330140.996057:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729437952 00000100:00100000:0.0:1788330140.996112:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 303 00000100:00100000:0.0:1788330140.996124:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729437952:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330140.996226:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729437952:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 91us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330140.996235:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 303 00000100:00100000:0.0:1788330140.996268:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438336 00000100:00100000:0.0:1788330140.996272:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438336 00000100:00100000:0.0:1788330140.996307:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438208 00000100:00100000:0.0:1788330140.996311:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438208 00000100:00100000:0.0:1788330140.996341:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 87 00000100:00100000:0.0:1788330140.996348:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729438336:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330140.996378:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+8:2346:x1875199729438336:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 30us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330140.996384:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 87 00000100:00100000:0.0:1788330140.996396:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 88 00000100:00100000:0.0:1788330140.996402:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729438208:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330140.996633:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b58b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729438208:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 23us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330140.996641:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 88 00000100:00100000:0.0:1788330140.996660:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438080 00000100:00100000:0.0:1788330140.996664:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438080 00000100:00100000:0.0:1788330140.996687:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438464 00000100:00100000:0.0:1788330140.996690:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438464 00000100:00100000:0.0:1788330140.996707:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 166 00000100:00100000:0.0:1788330140.996713:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:2346:x1875199729438080:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330140.996741:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+32:2346:x1875199729438080:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 28us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330140.996758:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 166 00000100:00100000:0.0:1788330140.996769:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 167 00000100:00100000:0.0:1788330140.996774:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729438464:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330140.996797:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfdb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:50c20128-def7-404a-9a1d-b928fec28af8+5:2346:x1875199729438464:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 22us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330140.996802:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 167 00000100:00080000:0.0:1788330140.996912:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330140.996916:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788330140.996918:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788330141.387655:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:0.0:1788330141.387690:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788330141.387706:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff95469b50a000 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788330141.387711:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff954691439700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9546a5f28840 00000020:00080000:0.0:1788330141.387715:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff954691439a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff95469b8e5800 00000020:00080000:1.0:1788330141.387753:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 5 00000020:00080000:1.0:1788330141.387941:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788330141.387986:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1788330141.391293:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1788330141.391307:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:3.0:1788330141.471131:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330141.857067:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750389888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857141:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.857189:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750390400:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857215:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.857243:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788330141.857248:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750390272:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857271:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.857298:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750390016:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857320:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.857345:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750390528:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857366:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.857384:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330141.857388:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750390144:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857408:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330141.857449:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750389888 00000100:00100000:2.0:1788330141.857455:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750389888 00000100:00100000:2.0:1788330141.857500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788330141.857510:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750389888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857587:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750389888:12345-0@lo:400:kworker.0 Request processed in 77us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.857594:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1788330141.857639:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390400 00000100:00100000:2.0:1788330141.857643:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390400 00000100:00100000:2.0:1788330141.857676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390016 00000100:00100000:2.0:1788330141.857680:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390016 00000100:00100000:2.0:1788330141.857692:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390144 00000100:00100000:2.0:1788330141.857695:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390144 00000100:00100000:2.0:1788330141.857709:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330141.857715:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750390400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857747:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750390400:12345-0@lo:400:kworker.0 Request processed in 33us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.857754:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788330141.857767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330141.857773:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750390016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857802:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750390016:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.857818:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788330141.857832:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788330141.857837:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750390144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857866:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750390144:12345-0@lo:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.857872:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788330141.857889:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390272 00000100:00100000:2.0:1788330141.857892:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390272 00000100:00100000:2.0:1788330141.857917:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390528 00000100:00100000:2.0:1788330141.857921:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390528 00000100:00100000:2.0:1788330141.857939:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330141.857945:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750390272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.857974:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750390272:12345-0@lo:400:kworker.0 Request processed in 30us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.857980:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788330141.857991:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788330141.857997:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750390528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.858022:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750390528:12345-0@lo:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330141.858027:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788330141.858065:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1788330141.858071:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1788330141.858089:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff95469b8b4a80, transno 4294967310 00000100:00100000:2.0:1788330141.858102:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750390272:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.858112:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750389888:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.858135:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750390400:0@lo:400:kworker.0 00000100:00080000:2.0:1788330141.858157:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330141.858160:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788330141.858163:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330141.858180:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfcf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750390144:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.858190:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfb7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750390016:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.858197:0:3314:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788330141.858201:0:3314:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:2.0:1788330141.858214:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750390528:0@lo:400:kworker.0 00000100:00100000:2.0:1788330141.859060:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750390656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788330141.859098:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330141.861099:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390656 00000100:00100000:1.0:1788330141.861113:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390656 00000100:00100000:1.0:1788330141.861163:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788330141.861173:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750390656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330141.861209:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330141.861297:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750390656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330141.861305:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788330141.861673:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750390656:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1788330142.495015:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788330142.495027:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330142.495341:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1788330142.495349:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788330142.496282:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330142.547861:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330142.548040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438592 00000100:00100000:2.0:1788330142.548052:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438592 00000100:00100000:2.0:1788330142.548141:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 238 00000100:00100000:2.0:1788330142.548153:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11298:x1875199729438592:12345-192.168.202.47@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788330142.548262:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11298:x1875199729438592:12345-192.168.202.47@tcp:60:lhsmtool_posix.0 Request processed in 112us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330142.548271:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 238 00000100:00080000:0.0:1788330142.549834:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330142.558483:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330142.558722:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438848 00000100:00100000:3.0:1788330142.558769:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438848 00000100:00100000:3.0:1788330142.558852:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:3.0:1788330142.558863:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:11298:x1875199729438848:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788330142.559387:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:11298:x1875199729438848:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 522us (5878us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788330142.559398:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 65 00000100:00100000:1.0:1788330142.896482:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330142.897593:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729438976 00000100:00100000:2.0:1788330142.897618:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729438976 00000100:00100000:2.0:1788330142.897708:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 239 00000100:00100000:2.0:1788330142.897720:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:12097:x1875199729438976:12345-192.168.202.47@tcp:101:lsof.0 00010000:00010000:2.0:1788330142.897741:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330142.897762:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab7be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef00 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330142.898211:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab7c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330142.898227:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330142.898238:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330142.900112:0:5845:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330142.900121:0:5845:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330142.900162:0:5845:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330142.900198:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dac00/0x91094de4de9ab7be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef00 expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330142.900218:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef00 expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330142.900228:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:2.0:1788330142.900230:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330142.900234:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da200, rc 0) 00000100:00100000:2.0:1788330142.900338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+6:12097:x1875199729438976:12345-192.168.202.47@tcp:101:lsof.0 Request processed in 2619us (3866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330142.900346:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 239 00000100:00080000:0.0:1788330142.901426:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788330143.518924:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330143.903296:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788330143.903321:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750390784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330143.903406:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330143.903487:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390784 00000100:00100000:1.0:1788330143.903497:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390784 00000100:00100000:1.0:1788330143.903602:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788330143.903613:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750390784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788330143.903649:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330143.903723:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750390784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330143.903731:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788330143.903842:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330143.903874:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750390784:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788330144.543358:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330145.566755:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330146.115348:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330146.115401:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330146.115429:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330146.115459:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729439360 00000100:00100000:1.0:1788330146.115459:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330146.115480:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729439360 00000100:00100000:1.0:1788330146.115491:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330146.115580:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729439616 00000100:00100000:3.0:1788330146.115587:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729439616 00000100:00100000:2.0:1788330146.115619:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729439488 00000100:00100000:2.0:1788330146.115625:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729439488 00000100:00100000:3.0:1788330146.115630:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729439232 00000100:00100000:3.0:1788330146.115635:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729439232 00000100:00100000:2.0:1788330146.115660:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:3.0:1788330146.115669:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 171 00000100:00100000:2.0:1788330146.115675:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729439360:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330146.115682:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729439616:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330146.115761:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2346:x1875199729439360:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 90us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.115771:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 172 00000100:00100000:2.0:1788330146.115772:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:1.0:1788330146.115787:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:2346:x1875199729439232:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330146.115798:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 92 00000100:00100000:2.0:1788330146.115806:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729439488:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330146.115877:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729439104 00000100:00100000:0.0:1788330146.115882:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729439104 00000100:00100000:0.0:1788330146.115925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 305 00000100:00100000:0.0:1788330146.115933:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729439104:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330146.117035:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bb30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729439616:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 1346us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.117049:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 171 00000100:00100000:1.0:1788330146.117152:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:2346:x1875199729439232:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 1369us (1691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.117160:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 172 00000100:00100000:2.0:1788330146.117185:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2346:x1875199729439488:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 1377us (1690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330146.117194:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 92 00000100:00100000:0.0:1788330146.117216:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2346:x1875199729439104:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 1279us (1874us total) trans 0 rc 0/0 00000100:00080000:2.0:1788330146.117228:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330146.117228:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 305 00000100:00080000:2.0:1788330146.117237:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330146.117242:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1788330146.374485:0:12814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 02:22:25 (1788330145) 00000020:00080000:3.0:1788330146.531902:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788330146.531934:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788330146.532061:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788330146.532079:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788330146.595447:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330146.986683:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750390912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330146.986757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330146.986827:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750390912 00000100:00100000:3.0:1788330146.986835:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750390912 00000100:00100000:3.0:1788330146.986890:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788330146.986899:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750390912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330146.986934:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330146.986976:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750390912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.986991:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788330146.987046:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750390912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788330146.987256:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330146.987329:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750391040:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.987414:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750391168:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987439:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.987467:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391168 00000100:00100000:1.0:1788330146.987472:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391168 00000100:00100000:1.0:1788330146.987500:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788330146.987507:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750391168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987645:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750391168:12345-0@lo:400:kworker.0 Request processed in 137us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.987652:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788330146.987679:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750391168:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987712:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330146.987718:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750391296:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987740:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.987763:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391296 00000100:00100000:1.0:1788330146.987767:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391296 00000100:00100000:1.0:1788330146.987793:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788330146.987799:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750391296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987843:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750391296:12345-0@lo:400:kworker.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.987851:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788330146.987876:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750391296:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987903:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750391424:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.987927:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.987953:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391424 00000100:00100000:1.0:1788330146.987957:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391424 00000100:00100000:1.0:1788330146.987983:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788330146.987989:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750391424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.988023:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750391424:12345-0@lo:400:kworker.0 Request processed in 34us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.988029:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788330146.988054:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750391424:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.988083:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330146.988089:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750391552:0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.988111:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330146.988132:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391552 00000100:00100000:1.0:1788330146.988135:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391552 00000100:00100000:1.0:1788330146.989257:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788330146.989336:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750391552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330146.989398:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750391552:12345-0@lo:400:kworker.0 Request processed in 67us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330146.989405:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788330146.989552:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750391552:0@lo:400:kworker.0 00000100:00080000:1.0:1788330146.990674:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330146.990689:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330146.990692:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330146.991293:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391040 00000100:00100000:3.0:1788330146.991304:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391040 00000100:00100000:3.0:1788330146.991370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788330146.991380:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750391040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330146.991471:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3315:x1875199750391040:12345-0@lo:400:kworker.0 Request processed in 92us (4105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330146.991478:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1788330146.991576:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3315:1875199750391040:0@lo:400:kworker.0 00010000:00010000:2.0:1788330147.618357:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330148.638732:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330149.023122:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750391680:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788330149.023212:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330149.023893:0:9440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391680 00000100:00100000:3.0:1788330149.023906:0:9440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391680 00000100:00100000:3.0:1788330149.023992:0:9440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788330149.024005:0:9440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750391680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330149.024049:0:9440:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788330149.024188:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330149.024247:0:9440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750391680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 236us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330149.024257:0:9440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330149.035641:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750391680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330149.662767:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330150.256369:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330150.256513:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729439872 00000100:00100000:3.0:1788330150.256560:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729439872 00000100:00100000:3.0:1788330150.256633:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00100000:3.0:1788330150.256654:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+19:12319:x1875199729439872:12345-192.168.202.47@tcp:35:umount.0 00000100:00100000:3.0:1788330150.257431:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+20:12319:x1875199729439872:12345-192.168.202.47@tcp:35:umount.0 Request processed in 676us (963us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1788330150.257455:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 66 00000100:00080000:1.0:1788330150.258501:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330150.265068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330150.265242:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729440128 00000100:00100000:0.0:1788330150.265254:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729440128 00000100:00100000:0.0:1788330150.265328:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 67 00000100:00100000:0.0:1788330150.265339:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+20:12319:x1875199729440128:12345-192.168.202.47@tcp:35:umount.0 00000100:00100000:0.0:1788330150.265791:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+21:12319:x1875199729440128:12345-192.168.202.47@tcp:35:umount.0 Request processed in 452us (733us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788330150.265799:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 67 00000100:00100000:2.0:1788330150.268662:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330150.269090:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729440384 00000100:00100000:0.0:1788330150.269101:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729440384 00000100:00100000:0.0:1788330150.269173:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:0.0:1788330150.269184:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954691d51850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+21:12319:x1875199729440384:12345-192.168.202.47@tcp:35:umount.0 00000100:00100000:0.0:1788330150.269430:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954691d51850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:12319:x1875199729440384:12345-192.168.202.47@tcp:35:umount.0 Request processed in 247us (787us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788330150.269453:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 68 00000100:00100000:1.0:1788330150.271961:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330150.272118:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729440640 00000100:00100000:0.0:1788330150.272140:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729440640 00000100:00100000:0.0:1788330150.272200:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00100000:0.0:1788330150.272212:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+22:12319:x1875199729440640:12345-192.168.202.47@tcp:35:umount.0 00000100:00100000:0.0:1788330150.272808:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7a815e47-382d-4064-91e8-23b9de97ce7e+23:12319:x1875199729440640:12345-192.168.202.47@tcp:35:umount.0 Request processed in 597us (867us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788330150.272817:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 69 00000100:00100000:2.0:1788330150.279723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330150.279771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330150.279804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330150.279843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330150.279876:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729441408 00000100:00100000:2.0:1788330150.279903:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729441408 00000100:00100000:2.0:1788330150.279986:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:2.0:1788330150.279998:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+7:2345:x1875199729441408:12345-192.168.202.47@tcp:9:umount.0 00000020:00000080:2.0:1788330150.280032:0:8194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aad6f 00000020:00010000:2.0:1788330150.280041:0:8194:0:(genops.c:1921:obd_stale_export_put()) Put export ffff954692958000: total 0 00000100:00080000:2.0:1788330150.280046:0:8194:0:(import.c:65:import_set_state_nolock()) ffff95469295a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330150.280083:0:8194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788330150.280403:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2345:x1875199729441408:12345-192.168.202.47@tcp:9:umount.0 Request processed in 407us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330150.280411:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:3.0:1788330150.280499:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729440768 00000100:00100000:3.0:1788330150.280504:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729440768 00000100:00100000:3.0:1788330150.280583:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729440896 00000100:00100000:3.0:1788330150.280586:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729440896 00000100:00100000:3.0:1788330150.280600:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729441024 00000100:00100000:3.0:1788330150.280602:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729441024 00000100:00100000:3.0:1788330150.280616:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:3.0:1788330150.280623:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a372850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+15:2347:x1875199729440768:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330150.280635:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330150.280657:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8000/0x91094de4de9aa836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea8b expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.280677:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330150.280698:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a372850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+14:2347:x1875199729440768:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 75us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330150.280705:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:3.0:1788330150.280751:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:3.0:1788330150.280758:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+13:2347:x1875199729440896:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330150.280766:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330150.280775:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d9600/0x91094de4de9aa79c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea53 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.280785:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330150.280802:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:2347:x1875199729440896:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 44us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330150.280808:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:3.0:1788330150.280832:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:3.0:1788330150.280837:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:2349:x1875199729441024:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330150.280845:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330150.280855:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bfacf000/0x91094de4de9aaa20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb56 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.280864:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330150.280882:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2349:x1875199729441024:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 44us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330150.280888:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00000020:00010000:1.0:1788330150.281141:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff954692958000: total 0 00010000:00010000:1.0:1788330150.281177:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff954692958000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788330150.281239:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd668443/0x91094de4de9ab112 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed2b expref: 4 pid: 8194 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330150.281271:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000099d24ca2/0x91094de4de9ab7b7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eef9 expref: 3 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330150.281287:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff954692958000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788330150.281298:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330150.281300:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330150.281302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330150.281313:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788330150.286431:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330150.286511:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729441536 00000100:00100000:1.0:1788330150.286566:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729441536 00000100:00100000:1.0:1788330150.286644:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:1.0:1788330150.286654:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+5:2345:x1875199729441536:12345-192.168.202.47@tcp:9:umount.0 00000020:00000080:1.0:1788330150.286683:0:6678:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9ab1ba 00000100:00080000:1.0:1788330150.286692:0:6678:0:(import.c:65:import_set_state_nolock()) ffff9546b78d4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788330150.286733:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788330150.287028:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a815e47-382d-4064-91e8-23b9de97ce7e+2:2345:x1875199729441536:12345-192.168.202.47@tcp:9:umount.0 Request processed in 375us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330150.287053:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 76 00010000:00010000:0.0:1788330150.287549:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330150.287621:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330150.299676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330150.299816:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729442560 00000100:00100000:2.0:1788330150.299826:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729442560 00000100:00100000:2.0:1788330150.299890:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 240 00000100:00100000:2.0:1788330150.299900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+23:2345:x1875199729442560:12345-192.168.202.47@tcp:39:umount.0 00000020:00000080:2.0:1788330150.299939:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa7aa 00000020:00010000:2.0:1788330150.299966:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9545852f5000: total 0 00000100:00080000:2.0:1788330150.299972:0:5844:0:(import.c:65:import_set_state_nolock()) ffff954585fd0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788330150.300010:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1788330150.300121:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9545852f5000: total 0 00010000:00010000:3.0:1788330150.300133:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330150.300192:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9545852f5000, canceled 0 locks, left on hash table 14. 00010000:00010000:3.0:1788330150.300248:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330150.300253:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788330150.300262:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d9400/0x91094de4de9ab7a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eef2 expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300290:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:3.0:1788330150.300293:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788330150.300298:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9ab0fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed24 expref: 22 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300316:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330150.300319:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330150.300324:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da400/0x91094de4de9ab476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ee20 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300371:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330150.300374:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788330150.300379:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9aaae4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb80 expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300396:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330150.300399:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330150.300403:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509e00/0x91094de4de9ab698 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeac expref: 20 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300416:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9546a5cd6000) 00010000:00010000:3.0:1788330150.300419:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788330150.300423:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface000/0x91094de4de9aadd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ec52 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300441:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9546a5cd6200) 00010000:00010000:3.0:1788330150.300444:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330150.300448:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9aaa74 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb64 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300465:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff954692606c00) 00010000:00010000:3.0:1788330150.300467:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788330150.300471:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20ccc00/0x91094de4de9ab190 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed4e expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300488:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:3.0:1788330150.300490:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1788330150.300496:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a815e47-382d-4064-91e8-23b9de97ce7e+14:2345:x1875199729442560:12345-192.168.202.47@tcp:39:umount.0 Request processed in 597us (841us total) trans 4294967525 rc 0/0 00010000:00010000:3.0:1788330150.300504:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509a00/0x91094de4de9aaff3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ecde expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330150.300510:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 240 00010000:00010000:3.0:1788330150.300594:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:3.0:1788330150.300597:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330150.300602:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9ab794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eeeb expref: 12 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300617:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:3.0:1788330150.300628:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330150.300634:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacfe00/0x91094de4de9ab174 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed47 expref: 11 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330150.300651:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330150.300653:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330150.300657:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c20cce00/0x91094de4de9aaa90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb6b expref: 10 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330150.301420:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:2.0:1788330150.301427:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330150.301434:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bf7d8e00/0x91094de4de9ab0d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ed16 expref: 9 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330150.301484:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff954692606500) 00010000:00010000:2.0:1788330150.301487:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788330150.301491:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface600/0x91094de4de9ab76a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eee4 expref: 8 pid: 10120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330150.301506:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9545852f5000, canceled 14 locks, left on hash table 0. 00010000:00010000:2.0:1788330150.301563:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330150.301566:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330150.301568:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330150.688847:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330151.236858:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330151.236911:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330151.237272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729442816 00000100:00100000:1.0:1788330151.237285:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729442816 00000100:00100000:1.0:1788330151.237381:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 176 00000100:00100000:1.0:1788330151.237393:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729442816:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330151.237494:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c20128-def7-404a-9a1d-b928fec28af8+6:2346:x1875199729442816:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 104us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330151.237502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 176 00000100:00100000:2.0:1788330151.237977:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729442688 00000100:00100000:2.0:1788330151.237984:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729442688 00000100:00100000:2.0:1788330151.238028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 307 00000100:00100000:2.0:1788330151.238036:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2346:x1875199729442688:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330151.238077:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2346:x1875199729442688:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 43us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330151.238085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 307 00000100:00080000:3.0:1788330151.238276:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1788330151.667354:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:0.0:1788330151.667373:0:7629:0:(genops.c:885:class_export_put()) final put ffff954692958000/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:2.0:1788330151.667442:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff954692958000/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-OST0001 00000020:00000080:2.0:1788330151.667502:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95469295a800 for lustre-OST0001 00000001:00080000:2.0:1788330151.699260:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:2.0:1788330151.699284:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000001:00080000:2.0:1788330151.699289:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788330151.699295:0:5866:0:(genops.c:885:class_export_put()) final put ffff9545852f5000/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:3.0:1788330151.699458:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9545852f5000/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-MDT0000 00000020:00000080:3.0:1788330151.699556:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff954585fd0800 for lustre-MDT0000 00010000:00010000:2.0:1788330151.710987:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330152.095764:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750392064:0@lo:400:kworker.0 00000100:00100000:2.0:1788330152.095842:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330152.095926:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330152.095932:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750392192:0@lo:400:kworker.0 00000100:00100000:2.0:1788330152.095959:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330152.096000:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392064 00000100:00100000:2.0:1788330152.096007:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392064 00000100:00100000:2.0:1788330152.096069:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788330152.096080:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750392064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330152.096131:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750392064:12345-0@lo:400:kworker.0 Request processed in 54us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330152.096138:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788330152.096160:0:8194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392192 00000100:00100000:2.0:1788330152.096163:0:8194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392192 00000100:00100000:2.0:1788330152.096187:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330152.096193:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750392192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330152.096218:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750392192:12345-0@lo:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330152.096223:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788330152.096257:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750392192:0@lo:400:kworker.0 00000100:00100000:2.0:1788330152.096265:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750392064:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096369:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750391936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330152.096430:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750392448:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096448:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330152.096469:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330152.096474:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750391808:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096496:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330152.096542:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750392320:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096561:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330152.096583:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392448 00000100:00100000:0.0:1788330152.096587:0:6678:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392448 00000100:00100000:0.0:1788330152.096619:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330152.096624:0:6678:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750392448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096654:0:6678:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750392448:12345-0@lo:400:kworker.0 Request processed in 31us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330152.096660:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788330152.096682:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391808 00000100:00100000:0.0:1788330152.096685:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391808 00000100:00100000:0.0:1788330152.096704:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788330152.096709:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750391808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3313:x1875199750391808:12345-0@lo:400:kworker.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330152.096736:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1788330152.096759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750391936 00000100:00100000:0.0:1788330152.096762:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750391936 00000100:00100000:0.0:1788330152.096776:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392320 00000100:00100000:0.0:1788330152.096778:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392320 00000100:00100000:0.0:1788330152.096791:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788330152.096796:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750391936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096822:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750391936:12345-0@lo:400:kworker.0 Request processed in 26us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330152.096828:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788330152.096838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788330152.096844:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750392320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096867:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750392320:12345-0@lo:400:kworker.0 Request processed in 24us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330152.096872:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788330152.096894:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750391808:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096912:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750392320:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096919:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750391936:0@lo:400:kworker.0 00000100:00100000:0.0:1788330152.096928:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750392448:0@lo:400:kworker.0 00000100:00080000:3.0:1788330152.097208:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788330152.097212:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330152.097215:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788330152.097362:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788330152.099120:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750392576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330152.099182:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330152.099336:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392576 00000100:00100000:1.0:1788330152.099344:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392576 00000100:00100000:1.0:1788330152.099425:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788330152.099434:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750392576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788330152.099471:0:6681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788330152.099563:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750392576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330152.099569:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788330152.099642:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750392576:0@lo:13:osp-pre-1-0.0 00000040:00080000:3.0:1788330152.734937:0:11669:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788330152.734949:0:11669:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788330152.735466:0:11669:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788330152.735474:0:11669:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788330152.735846:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330152.869064:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330152.869123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330152.869162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330152.869272:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729442944 00000100:00100000:3.0:1788330152.869300:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729442944 00000100:00100000:3.0:1788330152.869368:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729443200 00000100:00100000:3.0:1788330152.869372:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729443200 00000100:00100000:3.0:1788330152.869389:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729443072 00000100:00100000:3.0:1788330152.869391:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729443072 00000100:00100000:3.0:1788330152.869410:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:3.0:1788330152.869422:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+12:2348:x1875199729442944:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330152.869440:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330152.869464:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9aa87c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eaa0 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330152.869487:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330152.869601:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+11:2348:x1875199729442944:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 180us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330152.869609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:3.0:1788330152.869629:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:3.0:1788330152.869635:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+10:2348:x1875199729443200:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330152.869643:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330152.869653:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214e600/0x91094de4de9aaa19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eb4f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330152.869663:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330152.869680:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+9:2348:x1875199729443200:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 45us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330152.869686:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:3.0:1788330152.869699:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:3.0:1788330152.869706:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+8:2348:x1875199729443072:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330152.869723:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330152.869733:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a508e00/0x91094de4de9aa883 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eaca expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330152.869742:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330152.869760:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a12fed02-6dfe-42b9-b082-430e8d26c8c5+7:2348:x1875199729443072:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 55us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330152.869766:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:1.0:1788330152.897677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330152.897924:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729443456 00000100:00100000:0.0:1788330152.897936:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729443456 00000100:00100000:0.0:1788330152.898002:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 241 00000100:00100000:0.0:1788330152.898013:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+6:2345:x1875199729443456:12345-192.168.202.47@tcp:39:umount.0 00000020:00000080:0.0:1788330152.898055:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa891 00000020:00010000:0.0:1788330152.898064:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9546b7a30800: total 0 00000100:00080000:0.0:1788330152.898068:0:5845:0:(import.c:65:import_set_state_nolock()) ffff9546b7a30000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330152.898103:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1788330152.898565:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c20128-def7-404a-9a1d-b928fec28af8+5:2345:x1875199729443456:12345-192.168.202.47@tcp:39:umount.0 Request processed in 552us (898us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788330152.898574:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 241 00000020:00010000:3.0:1788330152.899373:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9546b7a30800: total 0 00010000:00010000:3.0:1788330152.899430:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9546b7a30800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788330152.899464:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9546a5cd6900) 00010000:00010000:3.0:1788330152.899469:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788330152.899480:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2da200/0x91094de4de9ab7c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef00 expref: 4 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330152.899574:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9546b7a30800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788330152.899587:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330152.899589:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330152.899590:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330152.959185:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330152.959315:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729443712 00000100:00100000:0.0:1788330152.959333:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729443712 00000100:00100000:0.0:1788330152.959436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 309 00000100:00100000:0.0:1788330152.959469:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+7:2345:x1875199729443712:12345-192.168.202.47@tcp:251:umount.0 00000020:00000080:0.0:1788330152.959608:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa787 00000020:00010000:0.0:1788330152.959620:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9545852f2800: total 0 00000100:00080000:0.0:1788330152.959625:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9545852f6800 : changing import state from FULL to CLOSED 00000020:00010000:2.0:1788330152.960548:0:5833:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9545852f2800: total 0 00010000:00010000:2.0:1788330152.960557:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330152.960660:0:5833:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9545852f2800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788330152.960717:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214e800/0x91094de4de9aa83d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ea92 expref: 3 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330152.960762:0:5833:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9545852f2800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788330152.960785:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330152.960802:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330152.960804:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330152.961103:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a12fed02-6dfe-42b9-b082-430e8d26c8c5+1:2345:x1875199729443712:12345-192.168.202.47@tcp:251:umount.0 Request processed in 1632us (1933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330152.961116:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 309 00000020:00000080:0.0:1788330152.961139:0:5837:0:(genops.c:885:class_export_put()) final put ffff9545852f2800/a12fed02-6dfe-42b9-b082-430e8d26c8c5 00000020:00000080:2.0:1788330152.962421:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9545852f2800/a12fed02-6dfe-42b9-b082-430e8d26c8c5 for MGS 00000020:00000080:2.0:1788330152.962537:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9545852f6800 for MGS 00010000:00010000:2.0:1788330153.760778:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330154.142670:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330154.142695:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750392704:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330154.142780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330154.142857:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392704 00000100:00100000:2.0:1788330154.142879:0:6679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392704 00000100:00100000:2.0:1788330154.142938:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788330154.142948:0:6679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750392704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788330154.142988:0:6679:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788330154.143033:0:6679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750392704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330154.143041:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788330154.143063:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788330154.143107:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750392704:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330154.790013:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788330154.806759:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:1.0:1788330154.806768:0:6702:0:(genops.c:885:class_export_put()) final put ffff9546b78d5000/7a815e47-382d-4064-91e8-23b9de97ce7e 00000020:00000080:0.0:1788330154.806818:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9546b78d5000/7a815e47-382d-4064-91e8-23b9de97ce7e for lustre-OST0000 00000020:00000080:0.0:1788330154.806863:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546b78d4800 for lustre-OST0000 00000020:01000004:3.0:1788330155.504127:0:13013:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788330155.533870:0:13013:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1788330155.533923:0:13013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.533939:0:13013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.533946:0:13013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.533971:0:13013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.534000:0:13013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788330155.534007:0:13013:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788330155.534032:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788330155.534036:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788330155.534043:0:13013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788330155.534070:0:13013:0:(import.c:65:import_set_state_nolock()) ffff95468a5a2800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788330155.534147:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750392832:0@lo:39:umount.0 00000100:00100000:0.0:1788330155.534236:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788330155.534492:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330155.534498:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.534507:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e000 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330155.534510:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.534550:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330155.534565:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330155.534570:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330155.534573:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788330155.534576:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788330155.534603:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.534609:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330155.534631:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.534637:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c214e000/0x91094de4de9aa80c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa813 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.534649:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330155.534650:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330155.534652:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330155.534755:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392832 00000100:00100000:3.0:1788330155.534763:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392832 00000100:00100000:3.0:1788330155.534812:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788330155.534822:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875199750392832:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788330155.534848:0:10120:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa596 00000100:00080000:3.0:1788330155.534855:0:10120:0:(import.c:65:import_set_state_nolock()) ffff9546bfda4800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788330155.534915:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b4f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3311:x1875199750392832:12345-0@lo:39:umount.0 Request processed in 94us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330155.534921:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788330155.534930:0:10120:0:(genops.c:885:class_export_put()) final put ffff9546bfda5000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788330155.534957:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330155.535011:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750392960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330155.535042:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788330155.535101:0:3311:0:(import.c:65:import_set_state_nolock()) ffff95468a5a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788330155.535110:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750392832:0@lo:39:umount.0 00000100:00100000:3.0:1788330155.535612:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750392960 00000100:00100000:3.0:1788330155.535618:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750392960 00000100:00100000:3.0:1788330155.535660:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788330155.535668:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3312:x1875199750392960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330155.535679:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330155.535696:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468148ac00/0x91094de4de9aa813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa80c expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.535724:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330155.535760:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:3312:x1875199750392960:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330155.535767:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788330155.535788:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788330155.535791:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788330155.535795:0:13013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788330155.541795:0:13013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541816:0:13013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541823:0:13013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541830:0:13013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330155.541836:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750392960:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330155.541862:0:13013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330155.541868:0:13013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541875:0:13013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541882:0:13013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541906:0:13013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541925:0:13013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330155.541932:0:13013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541939:0:13013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541945:0:13013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541951:0:13013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541960:0:13013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788330155.541965:0:13013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541976:0:13013:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541982:0:13013:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.541987:0:13013:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330155.542004:0:13013:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788330155.542008:0:13013:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788330155.542031:0:13013:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788330155.542035:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788330155.542038:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330155.542044:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1788330155.542049:0:13013:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff954698387000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330155.542055:0:13013:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9545849c6000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330155.542061:0:13013:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9546b7a30800 50c20128-def7-404a-9a1d-b928fec28af8 192.168.202.47@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330155.542067:0:13013:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9546b4ba19b8) has exports, disconnecting them 00000020:00080000:3.0:1788330155.542071:0:13013:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff954698387000), last request at 1788330152 00000020:00000080:3.0:1788330155.542078:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa709 00000020:00000080:1.0:1788330155.542079:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfda5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788330155.542095:0:13013:0:(import.c:65:import_set_state_nolock()) ffff954698385800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1788330155.542135:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546bfda4800 for lustre-MDT0000 00000020:00080000:3.0:1788330155.542136:0:13013:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff954698387000): rc 0 00000020:00000080:3.0:1788330155.542139:0:13013:0:(genops.c:885:class_export_put()) final put ffff954698387000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788330155.542148:0:13013:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9545849c6000), last request at 1788330152 00000020:00000080:3.0:1788330155.542151:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa630 00000100:00080000:3.0:1788330155.542156:0:13013:0:(import.c:65:import_set_state_nolock()) ffff9545849c6800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788330155.542163:0:13013:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9545849c6000): rc 0 00000020:00000080:3.0:1788330155.542165:0:13013:0:(genops.c:885:class_export_put()) final put ffff9545849c6000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788330155.542171:0:13013:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa44481a03ae0 00000100:00080000:3.0:1788330155.542200:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788330155.542204:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788330155.542216:0:13013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000020:00000080:1.0:1788330155.542235:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff954698387000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788330155.542273:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9545849c6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1788330155.542284:0:13013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:00000080:1.0:1788330155.542300:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff954698385800 for lustre-MDT0000 00000020:00000080:1.0:1788330155.542303:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9545849c6800 for lustre-MDT0000 00000100:00080000:3.0:1788330155.542304:0:13013:0:(import.c:65:import_set_state_nolock()) ffff95469db94000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788330155.542322:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788330155.542325:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788330155.542340:0:13013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788330155.542406:0:13013:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788330155.542416:0:13013:0:(import.c:65:import_set_state_nolock()) ffff9545852f2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788330155.542448:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9546b4ba19b8) has no exports 00010000:00010000:2.0:1788330155.543726:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788330155.543738:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543761:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9c00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330155.543764:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543774:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330155.543792:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330155.543798:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330155.543800:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788330155.543803:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788330155.543833:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543840:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330155.543867:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543873:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9c00/0x91094de4de9aa81a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa821 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543885:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788330155.543888:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543893:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8800 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330155.543896:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543901:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330155.543907:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330155.543921:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330155.543924:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788330155.543925:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788330155.543938:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543943:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330155.543963:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543969:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d8800/0x91094de4de9aa741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa748 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543985:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330155.543988:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.543993:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf200 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330155.543996:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544002:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330155.544007:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330155.544012:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788330155.544014:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788330155.544016:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788330155.544034:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544039:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330155.544045:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544051:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9aaa43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aaa4a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544059:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330155.544062:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544068:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c20cca00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330155.544071:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544077:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330155.544082:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330155.544087:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330155.544089:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788330155.544091:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788330155.544100:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544105:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788330155.544110:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544122:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cca00/0x91094de4de9aa4f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa4fc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544133:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330155.544134:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330155.544137:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330155.544181:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750393472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330155.544253:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330155.544299:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330155.544305:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750393600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330155.544326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330155.544354:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393472 00000100:00100000:2.0:1788330155.544360:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393472 00000100:00100000:2.0:1788330155.544396:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393600 00000100:00100000:2.0:1788330155.544399:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393600 00000100:00100000:2.0:1788330155.544418:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330155.544426:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468a3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+19:3314:x1875199750393472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330155.544436:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330155.544448:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680031e00/0x91094de4de9aa748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa741 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544460:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788330155.544506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468a3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+18:3314:x1875199750393472:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330155.544513:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788330155.544589:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788330155.544604:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3314:x1875199750393600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330155.544618:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330155.544626:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a508400/0x91094de4de9aaa4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aaa43 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544634:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330155.544642:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750393344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330155.544655:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+16:3314:x1875199750393600:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330155.544661:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330155.544673:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330155.544678:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750393728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330155.544698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330155.544704:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393344 00000100:00100000:3.0:1788330155.544708:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393344 00000100:00100000:3.0:1788330155.544725:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393728 00000100:00100000:3.0:1788330155.544728:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393728 00000100:00100000:2.0:1788330155.544730:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750393600:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330155.544739:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3314:1875199750393472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330155.544741:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330155.544746:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3313:x1875199750393344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330155.544753:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1788330155.544757:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788330155.544762:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680031800/0x91094de4de9aa821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa81a expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330155.544762:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+17:3312:x1875199750393728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330155.544769:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330155.544771:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330155.544775:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214f000/0x91094de4de9aa4fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa4f5 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330155.544786:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330155.544796:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:3313:x1875199750393344:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330155.544802:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788330155.544805:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+15:3312:x1875199750393728:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330155.544810:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330155.544824:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750393344:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330155.544824:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750393728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330155.544950:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330155.544962:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750393088:0@lo:9:umount.0 00000100:00100000:0.0:1788330155.544996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330155.545020:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750393216:0@lo:9:umount.0 00000100:00100000:0.0:1788330155.545044:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330155.545086:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393088 00000100:00100000:0.0:1788330155.545090:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393088 00000100:00100000:0.0:1788330155.545119:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393216 00000100:00100000:0.0:1788330155.545122:0:6676:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393216 00000100:00100000:0.0:1788330155.545154:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788330155.545177:0:6676:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875199750393088:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788330155.545199:0:6676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa67d 00000100:00080000:0.0:1788330155.545207:0:6676:0:(import.c:65:import_set_state_nolock()) ffff9545849c0000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788330155.545235:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788330155.545447:0:8194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788330155.545458:0:8194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875199750393216:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788330155.545492:0:8194:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa772 00000100:00080000:2.0:1788330155.545499:0:8194:0:(import.c:65:import_set_state_nolock()) ffff954698382800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788330155.545782:0:6676:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3311:x1875199750393088:12345-0@lo:9:umount.0 Request processed in 605us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330155.545791:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1788330155.545809:0:5840:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330155.545830:0:3311:0:(import.c:65:import_set_state_nolock()) ffff95469db94000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788330155.545840:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788330155.545843:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330155.545846:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750393088:0@lo:9:umount.0 00000001:00000004:2.0:1788330155.547131:0:8194:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788330155.547949:0:8194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3311:x1875199750393216:12345-0@lo:9:umount.0 Request processed in 2490us (2900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330155.547960:0:8194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788330155.548412:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9545852f2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788330155.548433:0:3311:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788330155.548435:0:3311:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788330155.548439:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750393216:0@lo:9:umount.0 00010000:00010000:0.0:1788330155.549981:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330155.550661:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788330155.555330:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9546b4ba19b8) has no exports 00000020:00000080:0.0:1788330155.639438:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa550 00000020:00000080:0.0:1788330155.639454:0:13013:0:(genops.c:885:class_export_put()) final put ffff95469db95000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788330155.639640:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788330155.643100:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330155.643121:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788330155.643128:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff954691404d28) has no exports 00000020:00000080:2.0:1788330155.645789:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95469db95000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788330155.649691:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa549 00000020:00000080:1.0:1788330155.649705:0:13013:0:(genops.c:885:class_export_put()) final put ffff95469db81000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788330155.649776:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330155.649787:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788330155.649790:0:13013:0:(genops.c:885:class_export_put()) final put ffff95469db87800/lustre-QMT0000_UUID 00000020:00000080:1.0:1788330155.649793:0:13013:0:(genops.c:844:class_export_destroy()) destroying export ffff95469db87800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788330155.649799:0:13013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1788330155.650089:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff95469db81000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:0.0:1788330155.811330:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788330156.762743:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330156.762753:0:7629:0:(genops.c:885:class_export_put()) final put ffff954698386800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330156.762815:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff954698386800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788330156.762862:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff954698382800 for lustre-OST0001 00000001:00100000:3.0:1788330156.769116:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 50c20128-def7-404a-9a1d-b928fec28af8 00000001:00080000:3.0:1788330156.769156:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788330156.769175:0:5866:0:(genops.c:885:class_export_put()) final put ffff9546b7a30800/50c20128-def7-404a-9a1d-b928fec28af8 00000020:00000080:0.0:1788330156.769217:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546b7a30800/50c20128-def7-404a-9a1d-b928fec28af8 for lustre-MDT0000 00000020:00000080:0.0:1788330156.769285:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546b7a30000 for lustre-MDT0000 00010000:00010000:1.0:1788330156.830750:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330157.214989:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750394112:0@lo:400:kworker.0 00000100:00100000:1.0:1788330157.215065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330157.215138:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330157.215144:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750393984:0@lo:400:kworker.0 00000100:00100000:1.0:1788330157.215184:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330157.215217:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750394112 00000100:00100000:1.0:1788330157.215224:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750394112 00000100:00100000:1.0:1788330157.215261:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393984 00000100:00100000:1.0:1788330157.215264:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393984 00000100:00100000:1.0:1788330157.215282:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788330157.215289:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875199750394112:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788330157.215298:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788330157.215338:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875199750394112:12345-0@lo:400:kworker.0 Request processed in 47us (272us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788330157.215427:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788330157.215444:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788330157.215449:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875199750393984:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788330157.215453:0:5845:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788330157.215488:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b7c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3315:x1875199750393984:12345-0@lo:400:kworker.0 Request processed in 38us (304us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788330157.215494:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788330157.215760:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788330157.215764:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9545852f5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788330157.215768:0:3315:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788330157.216674:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750393856:0@lo:400:kworker.0 00000100:00100000:3.0:1788330157.216713:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330157.216790:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750393856 00000100:00100000:0.0:1788330157.216795:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750393856 00000100:00100000:0.0:1788330157.216832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788330157.216839:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:3313:x1875199750393856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330157.216881:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95468ab51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6+14:3313:x1875199750393856:12345-0@lo:400:kworker.0 Request processed in 42us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330157.216898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788330157.217021:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750393856:0@lo:400:kworker.0 00000100:00080000:1.0:1788330157.236748:0:3315:0:(import.c:65:import_set_state_nolock()) ffff9545852f5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330157.236761:0:3315:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 198 00000100:00080000:1.0:1788330157.236771:0:3315:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9545852f5800 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:1.0:1788330157.236812:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469bc39c00 x1875199750394240/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330157.236919:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875199750394240:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788330157.236999:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330157.237099:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750394240 00000100:00100000:0.0:1788330157.237108:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750394240 00000100:00100000:2.0:1788330157.237703:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788330157.237713:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875199750394240:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788330157.237732:0:5846:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788330157.240293:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750393984:0@lo:400:kworker.0 00000100:00080000:1.0:1788330157.240343:0:3315:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788330157.240360:0:3315:0:(import.c:65:import_set_state_nolock()) ffff954698386000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788330157.240365:0:3315:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788330157.240370:0:3315:0:(import.c:65:import_set_state_nolock()) ffff954698386000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330157.240374:0:3315:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 216 00000100:00080000:1.0:1788330157.240382:0:3315:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff954698386000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:1.0:1788330157.240419:0:3315:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546b4bfb100 x1875199750394368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330157.252887:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750394368:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788330157.252945:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330157.253140:0:10120:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750394368 00000100:00100000:0.0:1788330157.253152:0:10120:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750394368 00000100:00100000:0.0:1788330157.253212:0:10120:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788330157.253220:0:10120:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1875199750394368:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1788330157.253238:0:10120:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788330157.253271:0:10120:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1875199750394368:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 50us (326us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330157.253279:0:10120:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788330157.265966:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750394112:0@lo:400:kworker.0 00000100:00100000:2.0:1788330157.274429:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875199750394240:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 36704us (37417us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788330157.274446:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1788330157.274822:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9545852f5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330157.274829:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788330157.274833:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875199750394240:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788330157.274871:0:3311:0:(import.c:65:import_set_state_nolock()) ffff954698386000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330157.274875:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788330157.274878:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750394368:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1788330157.675291:0:13013:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95468a2675a0 - data ffff954584dcc000/ffff9545810bac00 00000020:01000000:2.0:1788330157.675480:0:13013:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9546b47872a0 - data ffff9546b1813000/ffff95469833fc00 00000001:00000004:2.0:1788330157.692911:0:13013:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788330157.855128:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788330157.855137:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00010000:00010000:1.0:1788330157.855343:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788330157.855385:0:13013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788330157.855388:0:13013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788330157.856398:0:6728:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788330157.856403:0:6728:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788330157.856411:0:6728:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788330157.857780:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788330157.857785:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788330157.857929:0:13013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788330157.857932:0:13013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788330157.858088:0:7917:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788330157.858091:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1788330157.858099:0:7917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788330157.980979:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa518 00000020:00000080:0.0:1788330157.980991:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546bfdbb800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788330157.981253:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfdbb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788330157.983972:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa52d 00000020:00000080:0.0:1788330157.983985:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546bfdba000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1788330157.984130:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788330157.984136:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330157.984144:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788330157.984149:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9546b4ba3370) has no exports 00000004:01000000:0.0:1788330157.984319:0:13013:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788330157.984327:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa76b 00000020:00000080:0.0:1788330157.984331:0:13013:0:(genops.c:885:class_export_put()) final put ffff954698382000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788330157.985337:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfdba000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788330157.996110:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788330157.996133:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330157.996147:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788330157.996152:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9546b4a899b8) has no exports 00000020:00000080:0.0:1788330157.996168:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa764 00000020:00000080:0.0:1788330157.996177:0:13013:0:(genops.c:885:class_export_put()) final put ffff9545852f7800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788330157.996185:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff954698382000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1788330157.997107:0:13013:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788330157.997112:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788330157.998497:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1788330157.999091:0:13013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330157.999094:0:13013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788330158.006693:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9545852f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788330158.026586:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330158.026605:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330158.026614:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa676 00000020:00000080:0.0:1788330158.026623:0:13013:0:(genops.c:885:class_export_put()) final put ffff95469db94800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330158.032635:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9545852f2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788330158.032652:0:8:0:(genops.c:885:class_export_put()) final put ffff9545852f1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330158.032656:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9545852f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788330158.032673:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788330158.036529:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1788330158.036603:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330158.036616:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788330158.036621:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff954691403370) has no exports 00000020:00000080:0.0:1788330158.036631:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa66f 00000020:00000080:0.0:1788330158.036638:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546bf39f800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788330158.043563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95469db94800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1788330158.047686:0:13013:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1788330158.047697:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788330158.047702:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1788330158.047711:0:13013:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788330158.047713:0:13013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788330158.049064:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bf39f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788330158.049468:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330158.049482:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330158.049784:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330158.049789:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330158.049796:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546b175c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788330158.049800:0:13013:0:(genops.c:844:class_export_destroy()) destroying export ffff9546b175c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788330158.049817:0:13013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788330158.050003:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa534 00000020:00000080:0.0:1788330158.050011:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546bfdb8000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788330158.053041:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788330158.053056:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330158.053066:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788330158.053071:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9546b4ba0000) has no exports 00000020:00000080:0.0:1788330158.053110:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330158.053145:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788330158.053153:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa53b 00000020:00000080:0.0:1788330158.053162:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546bfdbf800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788330158.053172:0:13013:0:(tgt_mount.c:187:server_put_mount()) put mount ffff954689604000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788330158.053175:0:13013:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954689604000 3 00000020:01000004:0.0:1788330158.053178:0:13013:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff954689604000 from lustre-MDT0000 00000020:00000080:0.0:1788330158.053201:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330158.053206:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788330158.053208:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546bfdb8800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788330158.053211:0:13013:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfdb8800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788330158.053222:0:13013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788330158.053282:0:13013:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1788330158.053286:0:13013:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788330158.053289:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788330158.053292:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330158.053294:0:13013:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788330158.053300:0:13013:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff954691417800 c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330158.053305:0:13013:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9546b46d0000) has exports, disconnecting them 00000020:00080000:0.0:1788330158.053309:0:13013:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff954691417800), last request at 1788329921 00000020:00000080:0.0:1788330158.053324:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa4d9 00000020:00010000:0.0:1788330158.053328:0:13013:0:(genops.c:1921:obd_stale_export_put()) Put export ffff954691417800: total 2 00000100:00080000:0.0:1788330158.053332:0:13013:0:(import.c:65:import_set_state_nolock()) ffff954691410000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788330158.053368:0:13013:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff954691417800): rc 0 00000020:00080000:0.0:1788330158.053373:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9546b46d0000) has no exports 00000020:00010000:0.0:1788330158.053389:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff954691417800: total 2 00010000:00010000:0.0:1788330158.053411:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff954691417800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788330158.053440:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff954680031200/0x91094de4de9aa5e3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa5dc expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053471:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bfacee00/0x91094de4de9aaa2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aaa27 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053496:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a509800/0x91094de4de9aaa3c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aaa35 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053687:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d9800/0x91094de4de9aa82f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa828 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053701:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546c214fa00/0x91094de4de9aa7e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa7e2 expref: 5 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053711:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8400/0x91094de4de9aa7db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa7d4 expref: 4 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053725:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468148b000/0x91094de4de9aa7f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa7f0 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053735:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8600/0x91094de4de9aa805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x91094de4de9aa7fe expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330158.053747:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff954691417800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788330158.053760:0:5832:0:(genops.c:885:class_export_put()) final put ffff954691417800/c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 00010000:00010000:0.0:1788330158.053777:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330158.053780:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330158.053782:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330158.053849:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9546b4b5c800:5837] 0 exiting: rc = 1 00000100:00100000:0.0:1788330158.053947:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9546b4b5de00:5839] 2 exiting: rc = 0 00000020:00000080:2.0:1788330158.054274:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95469db94000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788330158.054283:0:8:0:(genops.c:885:class_export_put()) final put ffff954698387800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788330158.054293:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff954698387800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788330158.054304:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788330158.054475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfdb8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788330158.054480:0:8:0:(genops.c:885:class_export_put()) final put ffff9546bfdba800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788330158.054483:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfdba800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788330158.054486:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788330158.054816:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfdbf800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788330158.054821:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff954691417800/c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 for MGS 00000100:00100000:3.0:1788330158.054995:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9546b4b5dc00:5838] 1 exiting: rc = 0 00000100:00100000:0.0:1788330158.055298:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055305:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055310:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055317:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055323:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055337:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055356:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055361:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055367:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055372:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055378:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055384:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055389:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055395:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055401:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055407:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055414:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055421:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055427:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055432:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055437:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055443:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055448:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055453:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055469:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055476:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055486:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055492:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055497:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055515:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055539:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055544:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055550:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055556:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055561:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055567:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055571:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055576:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055581:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055586:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055599:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055606:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055611:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055616:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055621:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055625:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055630:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055635:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055639:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055645:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055651:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055656:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055660:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055665:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055670:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055676:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055681:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055687:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055692:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055698:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055703:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055708:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055713:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.055718:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1788330158.056088:0:13013:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788330158.056092:0:13013:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1788330158.057834:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff954691410000 for MGS 00000020:01000000:0.0:1788330158.058402:0:13013:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9546a2794000 - data ffff95469a739d80/ffff9546bfcf5400 00000020:01000000:1.0:1788330158.059029:0:13013:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff95468a0ceba0 - data ffff9546ba74c6c0/ffff9546b4a36000 00000020:00000080:1.0:1788330158.059788:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa4bd 00000020:00000080:1.0:1788330158.059796:0:13013:0:(genops.c:885:class_export_put()) final put ffff954682fcb000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788330158.059816:0:13013:0:(tgt_mount.c:187:server_put_mount()) put mount ffff954689604000 from MGS, refs=2 00000020:01000004:1.0:1788330158.059820:0:13013:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954689604000 2 00000020:01000004:1.0:1788330158.059823:0:13013:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff954689604000 from MGS 00000020:00000080:1.0:1788330158.059849:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330158.059855:0:13013:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788330158.059858:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546831ed800/MGS 00000020:00000080:1.0:1788330158.059860:0:13013:0:(genops.c:844:class_export_destroy()) destroying export ffff9546831ed800/MGS for MGS 00000020:01000000:1.0:1788330158.059867:0:13013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788330158.059939:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788330158.059943:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330158.059949:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788330158.059956:0:13013:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff95468a5a2000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788330158.059963:0:13013:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9546b4a8b370) has exports, disconnecting them 00000020:00080000:1.0:1788330158.059967:0:13013:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff95468a5a2000), last request at 1788329922 00000020:00000080:1.0:1788330158.059972:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa588 00000020:00080000:1.0:1788330158.059980:0:13013:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95468a5a2000): rc 0 00000020:00000080:1.0:1788330158.059984:0:13013:0:(genops.c:885:class_export_put()) final put ffff95468a5a2000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788330158.060195:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff954682fcb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788330158.060202:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff95468a5a2000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788330158.063620:0:13013:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788330158.063629:0:13013:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330158.063633:0:13013:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788330158.063641:0:13013:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788330158.063823:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330158.063832:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788330158.063838:0:13013:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954689604000 1 00000020:00000080:0.0:1788330158.063857:0:13013:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa4af 00000020:00000080:0.0:1788330158.063867:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546a1e51800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788330158.063872:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788330158.063877:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330158.063881:0:13013:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788330158.063885:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9546b46d19b8) has no exports 00000020:00000080:2.0:1788330158.066444:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff95468a5a2800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788330158.066471:0:8:0:(genops.c:885:class_export_put()) final put ffff9546bfda3000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788330158.066475:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546bfda3000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788330158.066486:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788330158.066567:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a1e51800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788330158.222826:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788330158.222841:0:13013:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788330158.222847:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546a1d0a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788330158.222852:0:13013:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a1d0a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788330158.222861:0:13013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788330158.222990:0:13013:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9546a1d0c800 00000020:01000000:2.0:1788330158.223011:0:13013:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788330158.223015:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330158.223020:0:13013:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788330158.223024:0:13013:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff954691400000) has no exports 00000100:00100000:2.0:1788330158.223093:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9546b4bfd000:5846] 2 exiting: rc = 0 00000100:00100000:0.0:1788330158.225359:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9546b4bb1600:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1788330158.225473:0:10120:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9546a2786800:10120] 3 exiting: rc = 0 00000100:00100000:0.0:1788330158.225574:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff95469264fa00:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788330158.226117:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226126:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226206:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226215:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226221:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226227:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226234:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226239:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226245:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226250:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226258:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226263:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226268:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226274:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226279:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226285:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226289:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226294:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226299:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226315:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226323:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226328:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226333:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226338:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226343:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226349:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226354:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226358:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226363:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226367:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226372:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226377:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226382:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226387:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226393:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226398:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226403:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.226416:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227670:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227935:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227944:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227950:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227956:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227962:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227968:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227975:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227981:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227987:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227992:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.227997:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228004:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228011:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228016:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228022:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228027:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228032:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228037:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228042:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228047:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228052:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228057:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228062:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228067:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.228072:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330158.242648:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9546915d8a00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1788330158.242770:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9546b4bb0a00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1788330158.243654:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243664:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243670:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243675:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243681:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243686:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243692:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243698:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243717:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243723:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243729:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243734:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243740:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243745:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243751:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243757:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243762:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243768:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243774:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243779:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243783:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243789:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243793:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243798:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243803:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243808:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243813:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243818:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243823:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243828:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243834:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243839:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243843:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243848:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243853:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243859:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243864:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243870:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243878:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243883:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243888:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243893:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243898:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243912:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243918:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243924:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243930:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243936:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243941:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243946:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243951:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243956:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243961:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243966:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243972:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243977:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243982:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243987:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243992:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.243998:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.244003:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.244008:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.244014:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.244020:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330158.245009:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9546b4ab8c00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788330158.245103:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9546a5eefe00:5849] 0 exiting: rc = 1 00000100:00100000:2.0:1788330158.245739:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245748:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245773:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245781:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245786:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245794:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245803:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245812:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245818:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245825:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245832:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245838:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245844:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245849:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245885:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245892:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245897:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245903:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245908:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245914:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245919:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245926:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245932:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245938:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245944:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245949:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245969:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245976:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245982:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245989:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.245995:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246001:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246007:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246013:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246019:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246024:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246030:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246036:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246056:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246063:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246068:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246074:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246080:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246086:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246092:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246098:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246104:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246110:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246116:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246130:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246152:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246160:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246166:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246172:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246177:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246183:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246189:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246195:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246202:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246209:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246214:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246221:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246246:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.246256:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330158.268305:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9546b4ab9000:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788330158.269780:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9546b4ab8e00:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1788330158.269985:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.269996:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270004:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270011:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270019:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270027:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270034:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270041:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270052:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270062:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270072:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270077:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270082:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270087:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270091:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270096:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270101:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270106:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270111:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270116:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270259:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270266:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270272:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270277:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270283:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270288:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270294:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270300:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270304:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270310:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270315:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270321:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270326:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270332:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270338:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270344:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270349:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270354:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270360:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270365:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270370:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270375:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270381:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270387:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270393:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270398:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270404:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270409:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270415:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.270420:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275432:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275443:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275448:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275464:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275469:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275489:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275495:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275500:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275505:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275509:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275514:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275534:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275541:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330158.275548:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330158.279897:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9546b4ab7400:5854] 1 exiting: rc = 0 00000100:00100000:2.0:1788330158.282666:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9546b4ab6600:5853] 0 exiting: rc = 1 00000100:00100000:0.0:1788330158.283031:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283039:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283045:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283050:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283054:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283060:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283065:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283070:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283076:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283081:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283086:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283091:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283096:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283101:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283106:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283111:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283116:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283122:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283128:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283134:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283139:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283144:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283149:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283153:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283173:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283178:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283183:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283188:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283193:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283198:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283203:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283207:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283212:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283216:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283222:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283228:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283233:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283240:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283246:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283251:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283257:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283262:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283267:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283272:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283277:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283282:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283287:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283293:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283299:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283304:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283309:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283314:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283319:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283324:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283330:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283335:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283340:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283345:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283350:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283364:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283368:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283373:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283378:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.283384:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330158.285105:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9546b4ab6800:5855] 0 exiting: rc = 1 00000100:00100000:2.0:1788330158.285571:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9546b4ab7c00:5856] 1 exiting: rc = 0 00000100:00100000:0.0:1788330158.285822:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285831:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285837:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285842:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285847:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285853:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285859:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285865:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285870:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285875:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285880:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285886:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285890:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285895:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285900:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285905:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285911:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285917:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285922:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285927:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285932:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285938:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285943:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285947:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285953:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285958:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285963:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285969:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285975:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.285980:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286000:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286005:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286010:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286014:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286019:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286024:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286030:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286036:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286040:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286046:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286051:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286056:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286060:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286066:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286070:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286075:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286080:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286085:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286089:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286095:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286100:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286105:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286110:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286116:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286121:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286125:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286131:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286136:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286140:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286144:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286149:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286154:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286160:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.286165:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330158.290270:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9546b4bba800:5857] 0 exiting: rc = 1 00000100:00100000:2.0:1788330158.299059:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9546b4ab6a00:5858] 1 exiting: rc = 0 00000100:00100000:1.0:1788330158.308576:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9546b4ab7800:5859] 2 exiting: rc = 0 00000100:00100000:0.0:1788330158.308694:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308717:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308723:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308729:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308734:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308739:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308745:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308752:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308757:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308763:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308769:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308792:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308799:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308806:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308811:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308816:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308821:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308825:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308831:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308836:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308841:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308847:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308852:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308856:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308861:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308866:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308871:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308877:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308884:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308890:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308896:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308901:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308909:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308915:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308921:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308946:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308958:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308964:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308970:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308976:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308980:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308985:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308990:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.308996:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309001:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309007:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309013:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309020:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309025:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309030:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309035:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309041:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309046:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309052:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309057:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309063:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309068:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309074:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309080:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309086:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309091:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309096:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309101:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330158.309106:0:13013:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788330158.320633:0:13013:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330158.320647:0:13013:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788330158.320654:0:13013:0:(genops.c:885:class_export_put()) final put ffff9546a0054800/MDS_uuid 00000020:00000080:1.0:1788330158.320658:0:13013:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a0054800/MDS_uuid for MDS 00000020:01000000:1.0:1788330158.320664:0:13013:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788330158.320806:0:13013:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788330158.879162:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330159.903317:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330159.960107:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788330159.960123:0:6702:0:(genops.c:885:class_export_put()) final put ffff9545849c2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788330159.960257:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9545849c2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788330159.960328:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9545849c0000 for lustre-OST0000 00010000:00010000:1.0:1788330160.927661:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330161.950779:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788330162.191211:0:13167:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788330162.200754:0:13167:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788330162.200836:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.200850:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.200858:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.200865:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.200887:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788330162.200893:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788330162.200914:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330162.200919:0:13167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788330162.200924:0:13167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788330162.200930:0:13167:0:(import.c:65:import_set_state_nolock()) ffff9545852f5800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788330162.200949:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788330162.200951:0:13167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788330162.200954:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788330162.201466:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330162.201474:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330162.201491:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680031c00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788330162.201496:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330162.201567:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330162.201574:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330162.201581:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330162.201583:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788330162.201586:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788330162.201623:0:5833:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330162.201630:0:5833:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330162.201723:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330162.201732:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680031c00/0x91094de4de9aa7f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa7f7 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330162.201743:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330162.201745:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330162.201747:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330162.201767:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750394496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330162.201838:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330162.201921:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750394496 00000100:00100000:1.0:1788330162.201934:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750394496 00000100:00100000:1.0:1788330162.201982:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788330162.201989:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875199750394496:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1788330162.201996:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330162 with bad export cookie 10450970055672505561 00010000:00010000:2.0:1788330162.203904:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203921:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203928:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203935:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203967:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330162.203975:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203981:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203987:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.203993:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330162.204004:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788330162.204008:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788330162.204040:0:13167:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788330162.204044:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788330162.204048:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788330162.204053:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788330162.204057:0:13167:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff954585054d28) has no exports 00000020:00080000:2.0:1788330162.204081:0:13167:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff954585054d28) has no exports 00010000:00010000:0.0:1788330162.206331:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330162.206343:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.206368:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680030600 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788330162.206386:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.206396:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330162.206404:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330162.206410:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788330162.206412:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788330162.206425:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788330162.206476:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.206483:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788330162.207793:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750394624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330162.207879:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330162.207957:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750394624 00000100:00100000:3.0:1788330162.207965:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750394624 00000100:00100000:3.0:1788330162.208002:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788330162.208010:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875199750394624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788330162.208029:0:8437:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788330162 with bad export cookie 10450970055672505561 00000100:00100000:3.0:1788330162.208072:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1875199750394624:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (194us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788330162.208079:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788330162.208111:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.147@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788330162.208116:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9546a2690800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788330162.208119:0:3313:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.147@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788330162.208532:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.208544:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680030600/0x91094de4de9aa7fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aa805 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.208558:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330162.208563:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.208568:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509c00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788330162.208573:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.208582:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330162.208597:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330162.208603:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788330162.208605:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788330162.208609:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000020:01000000:2.0:1788330162.211547:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff954587c6fb40 - data ffff95469a677948/ffff95468a31cc00 00000020:01000000:2.0:1788330162.211819:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9546a2ce1360 - data ffff95468222f948/ffff9545852fb400 00010000:00010000:1.0:1788330162.213336:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330162.213484:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875199750394496:12345-0@lo:103:ldlm_bl.0 Request processed in 11488us (11641us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788330162.213497:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788330162.213574:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.147@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788330162.226379:0:3313:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.147@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788330162.226384:0:3313:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788330162.226394:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9546b4bf9180 x1875199750394496/t0(0) o103->MGC192.168.202.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330178 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330162.226410:0:3313:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9546bf812d80 x1875199750394624/t0(0) o103->MGC192.168.202.147@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788330178 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788330162.226432:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788330162.226435:0:3313:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788330162.226436:0:3313:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:0.0:1788330162.227102:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.227122:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330162.227150:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.227157:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9aaa35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x91094de4de9aaa3c expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330162.227176:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330162.227178:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330162.227180:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330162.227200:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:0:1875199750394752:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788330162.227312:0:3312:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9546a2690800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:1.0:1788330162.227943:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3312:1875199750394496:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788330162.228089:0:3313:0:(import.c:65:import_set_state_nolock()) ffff9546a2690800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330162.228096:0:3313:0:(import.c:510:import_select_connection()) MGC192.168.202.147@tcp: connect to NID 0@lo last attempt 176 00000100:00080000:3.0:1788330162.228104:0:3313:0:(import.c:624:import_select_connection()) MGC192.168.202.147@tcp: import ffff9546a2690800 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788330162.228190:0:3313:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469be21f80 x1875199750394880/t0(0) o250->MGC192.168.202.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330162.228239:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3311:1875199750394880:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1788330162.228293:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875199750394880 offset 0 length 520: 4 00000100:00100000:3.0:1788330162.228350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf812d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3313:1875199750394624:0@lo:103:ldlm_bl.0 00100000:10000000:1.0:1788330162.251839:0:13167:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788330162.268160:0:13167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa5ff 00000020:00000080:3.0:1788330162.268170:0:13167:0:(genops.c:885:class_export_put()) final put ffff95469f7f7000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788330162.268189:0:13167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9546a001c800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788330162.268193:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9546a001c800 2 00000020:01000004:3.0:1788330162.268196:0:13167:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9546a001c800 from lustre-OST0000 00000020:00000080:3.0:1788330162.268241:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788330162.268253:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788330162.268256:0:13167:0:(genops.c:885:class_export_put()) final put ffff95469f7f6000/lustre-OST0000_UUID 00000020:00000080:3.0:1788330162.268260:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff95469f7f6000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788330162.268276:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788330162.268325:0:13167:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788330162.268330:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788330162.268334:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330162.268339:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788330162.268346:0:13167:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff95468a5a4800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788330162.268352:0:13167:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff954585308000) has exports, disconnecting them 00000020:00080000:3.0:1788330162.268356:0:13167:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff95468a5a4800), last request at 1788329943 00000020:00000080:3.0:1788330162.268361:0:13167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa629 00000020:00080000:3.0:1788330162.268369:0:13167:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff95468a5a4800): rc 0 00000020:00000080:3.0:1788330162.268374:0:13167:0:(genops.c:885:class_export_put()) final put ffff95468a5a4800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788330162.269285:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff95469f7f7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788330162.269305:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff95468a5a4800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788330162.271747:0:13167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788330162.271755:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788330162.271759:0:13167:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788330162.271766:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788330162.272028:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788330162.272037:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788330162.272057:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9546a001c800 1 00000020:00000080:0.0:1788330162.272063:0:13167:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa5b9 00000020:00000080:0.0:1788330162.272072:0:13167:0:(genops.c:885:class_export_put()) final put ffff95468a5a6800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788330162.272259:0:12641:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9545852f5800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788330162.272267:0:12641:0:(genops.c:885:class_export_put()) final put ffff9545852f1000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788330162.272270:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff9545852f1000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788330162.272276:0:12641:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788330162.272404:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788330162.272410:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330162.272425:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788330162.272429:0:13167:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9546b46d4d28) has no exports 00000020:00000080:1.0:1788330162.272493:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff95468a5a6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788330162.288604:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330162.288621:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788330162.288628:0:13167:0:(genops.c:885:class_export_put()) final put ffff9546a0018800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788330162.288633:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a0018800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788330162.288708:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788330162.288846:0:13167:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9546a001e000 00000020:02000400:1.0:1788330162.288891:0:13167:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:0.0:1788330162.337104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788330162.337127:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788330162.337133:0:36:0:(import.c:65:import_set_state_nolock()) ffff954698386000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330162.337145:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 412 00000100:00080000:0.0:1788330162.337153:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788330162.337164:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff954698386000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:0.0:1788330162.337209:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546bf810a80 x1875199750395008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330162.337264:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750395008:0@lo:38:kworker.0 00000400:00000100:0.0:1788330162.337338:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875199750395008 offset 0 length 520: 4 00010000:00010000:2.0:1788330162.987369:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330164.002355:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788330164.819001:0:13316:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788330164.832249:0:13316:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788330164.832317:0:13316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.832330:0:13316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.832335:0:13316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.832339:0:13316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.832355:0:13316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788330164.832374:0:13316:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788330164.832380:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330164.832387:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788330164.832407:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788330164.832408:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680030e00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788330164.832412:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330164.832419:0:13316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9546bf810a80 x1875199750395008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330177 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1788330164.832421:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330164.832434:0:13316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 10000000:00010000:0.0:1788330164.832439:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788330164.832440:0:13316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 10000000:01000000:0.0:1788330164.832445:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00080000:3.0:1788330164.832446:0:13316:0:(import.c:65:import_set_state_nolock()) ffff954698386000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788330164.832447:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 00000100:00080000:3.0:1788330164.832450:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 10000000:01000000:0.0:1788330164.832450:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:3.0:1788330164.832453:0:13316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9546bf810a80 x1875199750395008/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788330177 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330164.832459:0:13316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788330164.832462:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:0.0:1788330164.832464:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9546a2690800 00010000:00010000:0.0:1788330164.832467:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330164.832474:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680030e00/0x91094de4de9aa7d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aa7db expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330164.832485:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330164.832487:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330164.832489:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330164.832534:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750395008:0@lo:38:kworker.0 00010000:00010000:3.0:1788330164.836706:0:13316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836729:0:13316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836738:0:13316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836746:0:13316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836777:0:13316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330164.836785:0:13316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836792:0:13316:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836889:0:13316:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836896:0:13316:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330164.836917:0:13316:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788330164.836923:0:13316:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788330164.836956:0:13316:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788330164.836961:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788330164.836967:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788330164.836975:0:13316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788330164.836981:0:13316:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff95458530cd28) has no exports 00010000:00010000:2.0:1788330164.837114:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330164.837122:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837140:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff954680030400 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330164.837145:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837156:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330164.837164:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330164.837170:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788330164.837173:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788330164.837175:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788330164.837191:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9546a2690800 00010000:00010000:2.0:1788330164.837195:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837203:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff954680030400/0x91094de4de9aa7e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aa7e9 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837228:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330164.837232:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837237:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f800 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:2.0:1788330164.837240:0:5833:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837247:0:5833:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788330164.837253:0:5833:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330164.837307:0:5833:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788330164.837309:0:5833:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788330164.837311:0:5833:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788330164.837317:0:5833:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9546a2690800 00010000:00010000:2.0:1788330164.837320:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837327:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c214f800/0x91094de4de9aaa27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aaa2e expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330164.837342:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330164.837344:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330164.837346:0:5833:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788330164.837442:0:13316:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff95458530cd28) has no exports 00010000:00010000:0.0:1788330164.837899:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788330164.842782:0:13316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff954587c6f6c0 - data ffff95469a6775e8/ffff9546bf951c00 00000020:01000000:3.0:1788330164.843507:0:13316:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff954682f60ae0 - data ffff9546b180f510/ffff95469da71800 00100000:10000000:3.0:1788330164.861127:0:13316:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788330164.949163:0:13316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa6d8 00000020:00000080:1.0:1788330164.949186:0:13316:0:(genops.c:885:class_export_put()) final put ffff954698381800/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788330164.949201:0:13316:0:(tgt_mount.c:187:server_put_mount()) put mount ffff954682f55000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788330164.949204:0:13316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954682f55000 2 00000020:01000004:1.0:1788330164.949207:0:13316:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff954682f55000 from lustre-OST0001 00000020:00000080:1.0:1788330164.949235:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330164.949245:0:13316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788330164.949248:0:13316:0:(genops.c:885:class_export_put()) final put ffff954698385000/lustre-OST0001_UUID 00000020:00000080:1.0:1788330164.949251:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff954698385000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788330164.949257:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788330164.949683:0:13316:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6->MGS 00010000:00010000:1.0:1788330164.949704:0:13316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c20cd000/0x91094de4de9aa5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330164.949719:0:13316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c20cd000/0x91094de4de9aa5dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330164.949726:0:13316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788330164.949730:0:13316:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788330164.949733:0:13316:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788330164.949749:0:13316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9546a2690800 00010000:00010000:1.0:1788330164.949752:0:13316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c20cd000/0x91094de4de9aa5dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aa5e3 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330164.949768:0:13316:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330164.949774:0:13316:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330164.949780:0:13316:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788330164.949783:0:13316:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788330164.949784:0:13316:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788330164.949805:0:13316:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9546a2690800 00010000:00010000:1.0:1788330164.949808:0:13316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546c214e200/0x91094de4de9aa828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x91094de4de9aa82f expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788330164.949828:0:13316:0:(import.c:65:import_set_state_nolock()) ffff9546a2690800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788330164.949832:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788330164.949835:0:13316:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788330164.949836:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788330164.949841:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788330164.949854:0:13316:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff95469be21f80 x1875199750394880/t0(0) o250->MGC192.168.202.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788330172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788330164.949884:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788330164.949899:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 00000020:00000080:0.0:1788330164.950092:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff954698381800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788330164.950170:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6:3311:1875199750394880:0@lo:250:ptlrpcd_00_01.0 10000000:01000000:1.0:1788330164.951388:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788330164.951415:0:13316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa4cb 00000020:00000080:1.0:1788330164.951426:0:13316:0:(genops.c:885:class_export_put()) final put ffff9546a0052800/c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 00000020:01000000:1.0:1788330164.951448:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.147@tcp (flags='') 00000020:00000080:1.0:1788330164.951458:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330164.951467:0:13316:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.147@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788330164.951472:0:13316:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9546b4ba4d28) has no exports 00000020:00000080:0.0:1788330164.951565:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a0052800/c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 for MGC192.168.202.147@tcp 10000000:01000000:2.0:1788330164.957497:0:5841:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788330164.957775:0:13316:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.147@tcp: client import never connected 00000100:00080000:1.0:1788330164.957780:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788330164.957786:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788330164.957790:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788330164.957792:0:13316:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788330164.958420:0:12641:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9546a2690800 for MGC192.168.202.147@tcp 00000020:00000080:1.0:1788330164.958433:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330164.958445:0:13316:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.147@tcp (uuid c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6) 00000020:00000080:1.0:1788330164.958450:0:13316:0:(genops.c:885:class_export_put()) final put ffff9546a2692000/c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 00000020:00000080:1.0:1788330164.958454:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a2692000/c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6 for MGC192.168.202.147@tcp 00000020:01000000:1.0:1788330164.958462:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.147@tcp (c468a9e7-1c10-454c-a5e3-2c43ba7ac9b6) 00000020:01000000:0.0:1788330164.960022:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788330164.960032:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788330164.960041:0:13316:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788330164.960049:0:13316:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff954698384000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788330164.960057:0:13316:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff954585053370) has exports, disconnecting them 00000020:00080000:0.0:1788330164.960062:0:13316:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff954698384000), last request at 1788329961 00000020:00000080:0.0:1788330164.960079:0:13316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa702 00000020:00080000:0.0:1788330164.960098:0:13316:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff954698384000): rc 0 00000020:00000080:0.0:1788330164.960104:0:13316:0:(genops.c:885:class_export_put()) final put ffff954698384000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788330164.961092:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff954698384000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:1.0:1788330164.961709:0:13316:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788330164.961731:0:13316:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788330164.961736:0:13316:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788330164.961743:0:13316:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788330164.961955:0:5833:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788330164.962103:0:12641:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff954698386000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788330164.962333:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788330164.962553:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff954689d12e00:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788330164.962852:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9546a5e1a800:5828] 1 exiting: rc = 0 00000100:00100000:1.0:1788330164.963088:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788330164.963904:0:8437:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff95469bb1f200:8437] 3 exiting: rc = 0 00000100:00100000:2.0:1788330164.963992:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff95468a45e600:5831] 2 exiting: rc = 0 00000100:00100000:1.0:1788330164.964098:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9546a1df9200:5829] 0 exiting: rc = 1 00000100:00100000:3.0:1788330164.964340:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9546833c3a00:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788330164.965019:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965030:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965037:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965042:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965048:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965053:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965059:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965064:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965071:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965077:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965090:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965100:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965106:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965113:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965120:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965126:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965135:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965141:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965146:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965151:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965155:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965161:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965168:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965176:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965181:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965188:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965193:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965199:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965336:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965342:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965349:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965353:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965358:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965363:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965368:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965373:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965379:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965384:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965400:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965406:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965413:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965419:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965424:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965430:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965436:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965441:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965447:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965453:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965686:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965695:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965701:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965707:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965712:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965912:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965919:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965924:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965929:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965933:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965938:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965944:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965949:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965954:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965960:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330164.965974:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788330164.967358:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330164.967371:0:13316:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1788330164.967378:0:13316:0:(genops.c:885:class_export_put()) final put ffff9546a2730800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1788330164.967383:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff9546a2730800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1788330164.967402:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1788330164.967447:0:13316:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954682f55000 1 00000020:00000080:1.0:1788330164.967455:0:13316:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x91094de4de9aa6a7 00000020:00000080:1.0:1788330164.967473:0:13316:0:(genops.c:885:class_export_put()) final put ffff954682f53800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788330164.967707:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788330164.967713:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330164.967725:0:13316:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788330164.967730:0:13316:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9546914019b8) has no exports 00000020:00000080:2.0:1788330164.968178:0:12641:0:(genops.c:844:class_export_destroy()) destroying export ffff954682f53800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788330165.046105:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330165.046125:0:13316:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788330165.046133:0:13316:0:(genops.c:885:class_export_put()) final put ffff954682f52000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788330165.046140:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff954682f52000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788330165.046154:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788330165.046386:0:13316:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff954682f56800 00000020:01000000:1.0:1788330165.046431:0:13316:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788330165.046437:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788330165.046443:0:13316:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788330165.046447:0:13316:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9546b46d3370) has no exports 00000020:00000080:1.0:1788330165.046480:0:13316:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788330165.046487:0:13316:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788330165.046490:0:13316:0:(genops.c:885:class_export_put()) final put ffff95468a5a5000/OSS_uuid 00000020:00000080:1.0:1788330165.046492:0:13316:0:(genops.c:844:class_export_destroy()) destroying export ffff95468a5a5000/OSS_uuid for OSS 00000020:01000000:1.0:1788330165.046495:0:13316:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788330165.046657:0:5840:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788330165.046796:0:6678:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9546bfae9200:6678] 2 exiting: rc = 0 00000100:00100000:2.0:1788330165.046966:0:8194:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9546bf1a7800:8194] 3 exiting: rc = 0 00000100:00100000:2.0:1788330165.047032:0:6676:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9546bfae9e00:6676] 0 exiting: rc = 1 00000100:00100000:1.0:1788330165.047592:0:6677:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9546bfae8c00:6677] 1 exiting: rc = 0 00000100:00100000:3.0:1788330165.047651:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047660:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047667:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047674:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047679:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047684:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047689:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047694:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047700:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047705:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047710:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047726:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047732:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047736:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047742:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047747:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047752:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047757:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047762:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047768:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047773:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047779:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047784:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047790:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047795:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047908:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047916:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047921:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047926:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047931:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047936:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047941:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047947:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047953:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047958:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047963:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047968:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047973:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047978:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047983:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047988:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047992:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.047997:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048002:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048006:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048011:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048021:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048026:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048033:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048038:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048043:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048047:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048053:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048059:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048064:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048069:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048075:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048080:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048086:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048096:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048102:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048278:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048283:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.048288:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.051795:0:9440:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff954585f88200:9440] 2 exiting: rc = 0 00000100:00100000:0.0:1788330165.051915:0:6679:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9546bfae8800:6679] 0 exiting: rc = 1 00000100:00100000:3.0:1788330165.052867:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9546bfa62000:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1788330165.053505:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053516:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053537:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053544:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053549:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053556:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053562:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053567:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053573:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053579:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053584:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053590:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053595:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053600:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053605:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053610:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053615:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053621:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053627:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053633:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053639:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053644:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053649:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053655:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053659:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053664:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053669:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053674:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053678:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053683:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053701:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053711:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053717:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053729:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053735:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053741:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053746:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053752:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053757:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053763:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053769:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053774:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053779:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053786:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053797:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053811:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053816:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053822:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053827:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053833:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053839:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053845:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053850:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053856:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053860:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053865:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053870:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053876:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053881:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053885:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053890:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053895:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053900:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.053905:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.057016:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff95469bf68e00:6684] 2 exiting: rc = 0 00000100:00100000:1.0:1788330165.057548:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff95469bf69c00:6682] 0 exiting: rc = 1 00000100:00100000:0.0:1788330165.058891:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff95469bf69e00:6683] 1 exiting: rc = 0 00000100:00100000:0.0:1788330165.058982:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.058988:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.058993:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.058997:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059001:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059010:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059015:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059019:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059023:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059026:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059030:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059034:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059038:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059041:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059045:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059048:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059051:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059054:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059058:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059061:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059065:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059068:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059078:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059082:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059085:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059089:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059092:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059095:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059098:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059102:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059105:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059108:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059112:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059115:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059119:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059128:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059132:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059136:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059142:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059146:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059150:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059154:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059158:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059161:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059165:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059168:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059180:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059184:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059187:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059191:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059194:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059198:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059201:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059205:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059208:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059212:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059651:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059658:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059665:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059670:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059676:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059682:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059687:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788330165.059693:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.064489:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9546bfa63400:6685] 0 exiting: rc = 1 00000100:00100000:3.0:1788330165.064692:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9546bfa63600:6686] 1 exiting: rc = 0 00000100:00100000:1.0:1788330165.070301:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070322:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070327:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070333:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070338:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070345:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070351:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070356:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070361:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070366:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070372:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070377:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070382:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070387:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070441:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070447:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070452:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070458:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070463:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070469:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070475:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070481:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070486:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070491:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070496:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070501:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070506:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070510:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070515:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070807:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070812:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070818:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070823:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070828:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070833:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070839:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070854:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070861:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070866:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070871:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070876:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070881:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070887:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070892:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070897:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070902:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070908:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070914:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070919:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070924:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070929:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070935:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070941:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070949:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070954:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070960:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070965:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070970:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070975:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070980:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070986:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070990:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.070996:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.071008:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788330165.073046:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9546bfaebe00:6687] 0 exiting: rc = 1 00000100:00100000:0.0:1788330165.073187:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff95469b790400:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1788330165.073370:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073379:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073385:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073401:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073408:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073415:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073421:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073439:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073446:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073452:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073458:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073464:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073469:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073488:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073494:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073500:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073506:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.073513:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074246:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074256:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074264:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074271:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074279:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074285:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074291:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074316:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074325:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074331:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074337:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074343:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074350:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074357:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074364:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074371:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074377:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074383:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074441:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074465:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074473:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074479:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074485:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074491:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074505:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074511:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074681:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074690:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074696:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074702:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074709:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074731:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074739:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074748:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074755:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074761:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074767:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074773:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074782:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074789:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074801:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074807:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074814:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074911:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074920:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788330165.074927:0:13316:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788330165.088424:0:13316:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788330183.648349:0:13931:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788330193.746987:0:14392:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788330193.746993:0:14392:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788330193.749431:0:14392:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff954683588800 00000020:01000004:0.0:1788330193.749468:0:14392:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788330193.749476:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788330193.749492:0:14392:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9546914019b8) 00000020:00000080:0.0:1788330193.749506:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788330193.793559:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788330193.817784:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788330193.818270:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:3.0:1788330193.818930:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788330193.819252:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 423: rc = 0 00100000:10000000:3.0:1788330193.822662:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 423: rc = 0 00100000:10000000:3.0:1788330193.822844:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 423: rc = 0 00100000:10000000:3.0:1788330193.824032:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 423: rc = 0 00100000:10000000:3.0:1788330193.824209:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:3.0:1788330193.824515:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 425: rc = 0 00100000:10000000:3.0:1788330193.828064:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 664: rc = 0 00100000:10000000:3.0:1788330193.828187:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 664: rc = 0 00100000:10000000:3.0:1788330193.832286:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 173: rc = 0 00100000:10000000:3.0:1788330193.832600:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 173: rc = 0 00100000:10000000:3.0:1788330193.832866:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 173: rc = 0 00100000:10000000:3.0:1788330193.833138:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 173: rc = 0 00100000:10000000:3.0:1788330193.833451:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 173: rc = 0 00100000:10000000:3.0:1788330193.833811:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 173: rc = 0 00100000:10000000:3.0:1788330193.834061:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 173: rc = 0 00100000:10000000:3.0:1788330193.842922:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 173: rc = 0 00100000:10000000:3.0:1788330193.843245:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 173: rc = 0 00100000:10000000:3.0:1788330193.847036:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 173: rc = 0 00100000:10000000:3.0:1788330193.847455:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 173: rc = 0 00100000:10000000:3.0:1788330193.847795:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 173: rc = 0 00100000:10000000:2.0:1788330193.854305:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 686: rc = 0 00100000:10000000:2.0:1788330193.854857:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 686: rc = 0 00100000:10000000:2.0:1788330193.855262:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 686: rc = 0 00100000:10000000:2.0:1788330193.857774:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 686: rc = 0 00100000:10000000:2.0:1788330193.858097:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 686: rc = 0 00100000:10000000:2.0:1788330193.858400:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 686: rc = 0 00100000:10000000:2.0:1788330193.863655:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 686: rc = 0 00100000:10000000:2.0:1788330193.863969:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 686: rc = 0 00100000:10000000:2.0:1788330193.865185:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 686: rc = 0 00100000:10000000:2.0:1788330193.866816:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 686: rc = 0 00100000:10000000:2.0:1788330193.867130:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 686: rc = 0 00100000:10000000:2.0:1788330193.867386:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 686: rc = 0 00100000:10000000:2.0:1788330193.867845:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 686: rc = 0 00100000:10000000:2.0:1788330193.868110:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 686: rc = 0 00100000:10000000:2.0:1788330193.868400:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 686: rc = 0 00100000:10000000:2.0:1788330193.872626:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 686: rc = 0 00100000:10000000:2.0:1788330193.872905:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 686: rc = 0 00100000:10000000:2.0:1788330193.873943:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 686: rc = 0 00100000:10000000:2.0:1788330193.874263:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 686: rc = 0 00100000:10000000:2.0:1788330193.875148:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 686: rc = 0 00100000:10000000:2.0:1788330193.875431:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 686: rc = 0 00100000:10000000:2.0:1788330193.875834:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 686: rc = 0 00100000:10000000:2.0:1788330193.876094:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 686: rc = 0 00100000:10000000:2.0:1788330193.876793:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 686: rc = 0 00100000:10000000:2.0:1788330193.877839:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 686: rc = 0 00100000:10000000:2.0:1788330193.878198:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 686: rc = 0 00100000:10000000:2.0:1788330193.882321:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 686: rc = 0 00100000:10000000:2.0:1788330193.882643:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 686: rc = 0 00100000:10000000:2.0:1788330193.882884:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 686: rc = 0 00100000:10000000:2.0:1788330193.883171:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 686: rc = 0 00100000:10000000:2.0:1788330193.883442:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 686: rc = 0 00100000:10000000:2.0:1788330193.883712:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 686: rc = 0 00100000:10000000:2.0:1788330193.884083:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 675: rc = 0 00100000:10000000:2.0:1788330193.884647:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788330193.884823:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 665: rc = 0 00100000:10000000:2.0:1788330193.885028:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788330193.885100:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 665: rc = 0 00100000:10000000:3.0:1788330193.887779:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788330193.887864:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 665: rc = 0 00100000:10000000:3.0:1788330193.888282:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788330193.888375:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 667: rc = 0 00100000:10000000:3.0:1788330193.888632:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788330193.888696:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 667: rc = 0 00100000:10000000:3.0:1788330193.888876:0:14392:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788330193.888944:0:14392:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 667: rc = 0 00000020:00000080:3.0:1788330193.889251:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788330193.889260:0:14392:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788330193.889272:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab7d3 00000020:01000004:3.0:1788330193.889280:0:14392:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788330193.889285:0:14392:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788330193.889295:0:14392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff954683588800 from MGS 00000020:01000004:3.0:1788330193.889299:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788330193.889310:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff954585054d28) 00000020:00000080:3.0:1788330193.889321:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788330193.889372:0:14392:0:(tgt_mount.c:153:server_get_mount()) get mount ffff954683588800 from MGS, refs=2 00080000:01000000:3.0:1788330193.889377:0:14392:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788330193.889381:0:14392:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab7e1 00000100:00100000:3.0:1788330193.889477:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788330193.889637:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788330193.889644:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788330193.900790:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788330193.900808:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788330193.901495:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330193.901739:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788330193.901745:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788330193.906705:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788330193.906724:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788330193.909491:0:14392:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788330193.909504:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788330193.916374:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330193.916380:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330193.916383:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330193.916846:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330193.916849:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330193.916851:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330193.918294:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788330193.924135:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788330193.944257:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788330193.944277:0:14392:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788330193.944280:0:14392:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788330193.960059:0:14401:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788330193.960307:0:14392:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788330193.960714:0:14392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788330193.963438:0:14392:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788330193.965577:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330193.965767:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788330193.965781:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788330193.968752:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788330193.968766:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788330193.971234:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788330193.971252:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788330193.973154:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788330193.973180:0:14392:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.147@tcp' 00000020:01000004:3.0:1788330193.973182:0:14392:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788330193.973216:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.147@tcp (typ=mgc) 00000020:00000080:3.0:1788330193.973229:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.147@tcp (ffff9545850519b8) 00000020:00000080:3.0:1788330193.973244:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788330193.973318:0:14392:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95469db93800@MGC192.168.202.147@tcp: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788330193.973495:0:14392:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.147@tcp-0 is initialized 00000040:01000000:3.0:1788330193.973503:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 1 is initialized 10000000:01000000:2.0:1788330193.976319:0:14407:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000100:00080000:0.0:1788330193.976850:0:14406:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788330193.977913:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.147@tcp (uuid 0d3423e3-6627-4c3c-887c-947ddc53be01) 00000020:00000080:3.0:1788330193.977939:0:14392:0:(genops.c:1385:class_connect()) connect: client 0d3423e3-6627-4c3c-887c-947ddc53be01, cookie 0x91094de4de9ab7ef 00000100:00080000:3.0:1788330193.977952:0:14392:0:(import.c:510:import_select_connection()) MGC192.168.202.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330193.978036:0:14392:0:(import.c:624:import_select_connection()) MGC192.168.202.147@tcp: import ffff95469db93800 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788330193.978075:0:14392:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469be22300 x1875199750395136/t0(0) o250->MGC192.168.202.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788330193.978180:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0d3423e3-6627-4c3c-887c-947ddc53be01:3311:1875199750395136:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788330193.978252:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330193.978351:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395136 00000100:00100000:1.0:1788330193.978359:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395136 00000100:00100000:1.0:1788330193.978400:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330193.978407:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3311:x1875199750395136:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788330193.978431:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 0d3423e3-6627-4c3c-887c-947ddc53be01@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:1.0:1788330193.978460:0:14403:0:(genops.c:1385:class_connect()) connect: client 0d3423e3-6627-4c3c-887c-947ddc53be01, cookie 0x91094de4de9ab7f6 00000100:00080000:1.0:1788330193.978610:0:14403:0:(import.c:65:import_set_state_nolock()) ffff95469be05000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788330193.984952:0:14392:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0d3423e3-6627-4c3c-887c-947ddc53be01->MGS 00000020:01000004:3.0:1788330193.984994:0:14392:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788330193.985004:0:14392:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788330193.985029:0:14392:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff954585050000) 00000020:00000080:3.0:1788330193.985058:0:14392:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788330193.991432:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+5:3311:x1875199750395136:12345-0@lo:250:mount.lustre.0 Request processed in 13007us (13163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330193.991449:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330194.003739:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330194.004320:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788330194.004382:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788330194.005196:0:3311:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788330194.005210:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.147@tcp: connect to target with instance 0 00000100:00080000:0.0:1788330194.005220:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788330194.005227:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788330194.005233:0:3311:0:(import.c:65:import_set_state_nolock()) ffff95469db93800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788330194.005237:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788330194.005247:0:3311:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788330194.005257:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0d3423e3-6627-4c3c-887c-947ddc53be01:3311:1875199750395136:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788330194.012919:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788330194.012946:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788330194.013597:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788330194.013605:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788330194.014579:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330194.014777:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788330194.014783:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788330194.020732:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788330194.020753:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788330194.091191:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330194.093203:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788330194.093220:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788330194.094944:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788330194.094956:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788330194.095921:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788330194.096195:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788330194.096201:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788330194.096906:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788330194.096921:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788330194.097728:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330194.098092:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788330194.098105:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788330194.101325:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788330194.101404:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788330194.106376:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330194.106591:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788330194.106598:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788330194.109194:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788330194.109211:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788330194.140147:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788330194.144336:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788330194.144351:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788330194.156069:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788330194.156085:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788330194.158151:0:14392:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788330194.158170:0:14392:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788330194.163062:0:14392:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788330194.163100:0:14392:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788330194.163106:0:14392:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788330194.163258:0:14392:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788330194.163295:0:14392:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.147@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788330194.163299:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788330194.163300:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788330194.163302:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330194.163303:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330194.163304:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330194.163305:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330194.163307:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788330194.163308:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788330194.163310:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330194.163311:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788330194.163313:0:14392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788330194.163315:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788330194.163316:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788330194.163317:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330194.163318:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330194.163319:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330194.163320:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330194.163321:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788330194.163322:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788330194.163323:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330194.163324:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788330194.163350:0:14392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788330194.163374:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395264:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788330194.163443:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.163561:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0ec1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330194.163903:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395264 00000100:00100000:0.0:1788330194.164023:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395264 00000100:00100000:0.0:1788330194.164105:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330194.164123:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+5:14392:x1875199750395264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330194.164183:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788330194.164186:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788330194.164188:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788330194.164691:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788330194.166196:0:14405:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788330194.168414:0:14426:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788330194.168421:0:14426:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788330194.168424:0:14426:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788330194.168454:0:14426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788330194.168904:0:14405:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788330194.169026:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788330194.179470:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+5:14392:x1875199750395264:12345-0@lo:253:mount.lustre.0 Request processed in 15345us (16015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.179486:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330194.179667:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395264:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788330194.179698:0:14392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788330194.179702:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330194.179704:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788330194.179706:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330194.179707:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330194.179708:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330194.179710:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330194.179711:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330194.179713:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788330194.179715:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330194.179716:0:14392:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788330194.179739:0:14392:0:(tgt_mount.c:101:server_register_mount()) register mount ffff954683588800 from lustre-MDT0000 10000000:01000000:1.0:1788330194.179768:0:14392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788330194.179771:0:14392:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788330194.179776:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9545850519b8 10000000:01000000:1.0:1788330194.179780:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788330194.179789:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9545850519b8 from 1 10000000:01000000:1.0:1788330194.179792:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788330194.179845:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.179857:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.179889:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.179923:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395392:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330194.179989:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.180039:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546813546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.180232:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395392 00000100:00100000:2.0:1788330194.180241:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395392 00000100:00100000:2.0:1788330194.180289:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330194.180300:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+5:14392:x1875199750395392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330194.180312:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330194.180327:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2da200/0x91094de4de9ab80b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab804 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330194.180354:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2da200/0x91094de4de9ab80b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab804 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330194.180365:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2da200/0x91094de4de9ab80b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab804 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330194.180375:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da200, rc 0) 00000100:00100000:2.0:1788330194.180419:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+6:14392:x1875199750395392:12345-0@lo:101:mount.lustre.0 Request processed in 121us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330194.180426:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330194.180775:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395392:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330194.180790:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.180800:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.181305:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.181349:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.181436:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546813546c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.185440:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395520 00000100:00100000:2.0:1788330194.185458:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395520 00000100:00100000:2.0:1788330194.187246:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330194.187267:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+6:14392:x1875199750395520:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330194.189569:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+6:14392:x1875199750395520:12345-0@lo:501:mount.lustre.0 Request processed in 2300us (8207us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330194.189596:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330194.193021:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395520:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788330194.193078:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788330194.193107:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.193130:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330194.193141:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff954683588800 10000000:01000000:1.0:1788330194.193151:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788330194.193172:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff954683588800 10000000:01000000:1.0:1788330194.193175:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788330194.193178:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff954683588800 from 1 10000000:01000000:1.0:1788330194.193181:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788330194.193221:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.193229:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.193241:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.193266:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330194.193333:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.193390:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546813546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330194.193711:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395648 00000100:00100000:3.0:1788330194.193718:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395648 00000100:00100000:3.0:1788330194.193773:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330194.193784:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+6:14392:x1875199750395648:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330194.193798:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330194.194074:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9400/0x91094de4de9ab819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab812 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.194112:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9400/0x91094de4de9ab819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab812 expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.194134:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9400/0x91094de4de9ab819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab812 expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.194144:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9400, rc 0) 00000100:00100000:3.0:1788330194.194203:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+7:14392:x1875199750395648:12345-0@lo:101:mount.lustre.0 Request processed in 421us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330194.194210:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788330194.194843:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330194.194862:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab819 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.194871:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab819 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330194.194887:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788330194.194903:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab819 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.194910:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509a00/0x91094de4de9ab812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab819 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330194.194940:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788330194.194945:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788330194.194951:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff954683588800 10000000:01000000:1.0:1788330194.194954:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788330194.194957:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788330194.194968:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788330194.194993:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.195001:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.195009:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.195026:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395776:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330194.195066:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.195109:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546813546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330194.196659:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395776 00000100:00100000:3.0:1788330194.196673:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395776 00000100:00100000:3.0:1788330194.196749:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330194.196759:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+7:14392:x1875199750395776:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330194.196775:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330194.196790:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9ab827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab820 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.196821:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9ab827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab820 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.196832:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8c00/0x91094de4de9ab827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab820 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.196841:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8c00, rc 0) 00000100:00100000:3.0:1788330194.196911:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+8:14392:x1875199750395776:12345-0@lo:101:mount.lustre.0 Request processed in 153us (1844us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330194.196919:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330194.197573:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395776:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330194.197595:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab827 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.197606:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab827 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.197692:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.197736:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.197794:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546813546c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330194.198161:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750395904 00000100:00100000:3.0:1788330194.198167:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750395904 00000100:00100000:3.0:1788330194.198207:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330194.198216:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+8:14392:x1875199750395904:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330194.198914:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14392:x1875199750395904:12345-0@lo:501:mount.lustre.0 Request processed in 698us (1176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330194.198924:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330194.199447:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750395904:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.199493:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330194.199575:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.199616:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546813546c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330194.199674:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750396032 00000100:00100000:0.0:1788330194.199695:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750396032 00000100:00100000:0.0:1788330194.199732:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330194.199740:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14392:x1875199750396032:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330194.200451:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14392:x1875199750396032:12345-0@lo:503:mount.lustre.0 Request processed in 709us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.200461:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330194.201675:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396032:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330194.203163:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14427:1875199750396160:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330194.203252:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.203312:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.203368:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750396160 00000100:00100000:2.0:1788330194.203376:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750396160 00000100:00100000:2.0:1788330194.203429:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788330194.203439:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14427:x1875199750396160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330194.204439:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14427:x1875199750396160:12345-0@lo:502:llog_process_th.0 Request processed in 998us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330194.204449:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330194.205191:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14427:1875199750396160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330194.205223:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.205233:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.205235:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788330194.205240:0:14427:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788330194.205243:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330194.205257:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9546b4a899b8) 00000020:00000080:1.0:1788330194.205277:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788330194.205282:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788330194.205349:0:14427:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788330194.205354:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab835 00000020:00000080:1.0:1788330194.205593:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788330194.205598:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.205601:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.205603:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788330194.205605:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.205608:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.205609:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788330194.205613:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330194.205627:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9546b4a88000) 00000020:00000080:1.0:1788330194.205636:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788330194.205639:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788330194.205641:0:14427:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788330194.205644:0:14427:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788330194.205650:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788330194.206303:0:14427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff954683588800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788330194.206319:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9546b4a8cd28) 00000020:00000080:1.0:1788330194.206328:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788330194.206387:0:14427:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788330194.206392:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9ab84a 00000020:00000080:1.0:1788330194.206489:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788330194.206495:0:14427:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788330194.206499:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x91094de4de9ab851 00080000:01000000:1.0:1788330194.206504:0:14427:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788330194.206507:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab858 00010000:00010000:2.0:1788330194.305693:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788330194.306126:0:14427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788330194.306343:0:14427:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788330194.306756:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff95458530b370) 00000020:00000080:2.0:1788330194.306771:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788330194.306820:0:14427:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788330194.306827:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab866 00000020:00000080:2.0:1788330194.311764:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788330194.323063:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x91094de4de9ab86d 00000020:00000080:3.0:1788330194.324055:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788330194.324068:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330194.324075:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.324077:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788330194.324081:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788330194.324083:0:14427:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788330194.324085:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330194.324087:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330194.324088:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788330194.324091:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.324092:0:14427:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788330194.324095:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330194.324099:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.324101:0:14427:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788330194.324104:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788330194.324153:0:14427:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788330194.324167:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330194.324170:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.324171:0:14427:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788330194.324174:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330194.324177:0:14427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788330194.324180:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.324181:0:14427:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788330194.324184:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330194.324197:0:14427:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.147@tcp to nid 0x20000c0a8ca93 (192.168.202.147@tcp) 00000020:01000000:3.0:1788330194.324224:0:14427:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788330194.324227:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330194.324243:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff954585053370) 00000020:00000080:3.0:1788330194.324258:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788330194.324262:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330194.324326:0:14427:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788330194.324331:0:14427:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788330194.324337:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab87b 00010000:00080000:3.0:1788330194.324369:0:14427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9546b175e000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788330194.324638:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788330194.325254:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788330194.325303:0:14427:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788330194.328780:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330194.329003:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788330194.329094:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788330194.329643:0:14431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330194.329648:0:14431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788330194.330491:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788330194.330505:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788330194.333503:0:14427:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788330194.333651:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9ab882 00000100:00080000:3.0:1788330194.333665:0:14427:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330194.333672:0:14427:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9546b175e000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788330194.333715:0:14427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469be20380 x1875199750396288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330194.333787:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750396288:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788330194.333844:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199750396288 offset 0 length 520: 4 00000100:00080000:3.0:1788330194.333919:0:14427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788330194.334004:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330194.334012:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.334014:0:14427:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788330194.334017:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788330194.334020:0:14427:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788330194.334037:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330194.334041:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788330194.334043:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788330194.334046:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.334047:0:14427:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788330194.334049:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788330194.334054:0:14427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788330194.334057:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330194.334058:0:14427:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788330194.334061:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788330194.334065:0:14427:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.147@tcp to nid 0x20000c0a8ca93 (192.168.202.147@tcp) 00000020:01000000:3.0:1788330194.334088:0:14427:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788330194.334091:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788330194.334130:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9546a0740000) 00000020:00000080:3.0:1788330194.334146:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788330194.334153:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788330194.334226:0:14427:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788330194.334232:0:14427:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788330194.334240:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x91094de4de9ab890 00010000:00080000:3.0:1788330194.334270:0:14427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9546a1ee2000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788330194.334511:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788330194.334781:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788330194.334805:0:14427:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788330194.335360:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330194.335441:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788330194.335515:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788330194.336607:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788330194.336613:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788330194.337740:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788330194.337756:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788330194.337790:0:14427:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788330194.337812:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9ab897 00000100:00080000:1.0:1788330194.337824:0:14427:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788330194.337829:0:14427:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9546a1ee2000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:1.0:1788330194.337869:0:14427:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546b4bf8e00 x1875199750396416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788330194.337998:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750396416:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788330194.338058:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199750396416 offset 0 length 520: 4 00000100:00080000:1.0:1788330194.338125:0:14427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788330194.338192:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.338197:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.338199:0:14427:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788330194.338203:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.338207:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.338208:0:14427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788330194.338211:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788330194.338224:0:14427:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788330194.338227:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.338229:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.338230:0:14427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788330194.338233:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.338235:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.338236:0:14427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788330194.338240:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788330194.338270:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14427:1875199750396544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330194.338325:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.338472:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.338739:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750396544 00000100:00100000:2.0:1788330194.338746:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750396544 00000100:00100000:2.0:1788330194.338828:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788330194.338839:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14427:x1875199750396544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788330194.339193:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14427:x1875199750396544:12345-0@lo:502:llog_process_th.0 Request processed in 354us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330194.339209:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330194.339291:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14427:1875199750396544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330194.339319:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.339324:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.339326:0:14427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788330194.339340:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788330194.339576:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1788330194.339596:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788330194.339616:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab827 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.339640:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509000/0x91094de4de9ab820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab827 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330194.339649:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954683588800 from 1 10000000:01000000:3.0:1788330194.339652:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330194.339682:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.339690:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.339700:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330194.339718:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788330194.339752:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.340397:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750396672 00000100:00100000:0.0:1788330194.340404:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750396672 00000100:00100000:1.0:1788330194.340509:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b46a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330194.340772:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788330194.340782:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+9:14392:x1875199750396672:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330194.340794:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330194.340811:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab89e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.340833:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab89e expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.340843:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab89e expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.340853:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508800, rc 0) 00000100:00100000:1.0:1788330194.341020:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+10:14392:x1875199750396672:12345-0@lo:101:mount.lustre.0 Request processed in 238us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.341027:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788330194.341125:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396672:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330194.341148:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.341158:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330194.342028:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396800:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788330194.342083:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.342170:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.342216:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750396800 00000100:00100000:2.0:1788330194.342223:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750396800 00000100:00100000:2.0:1788330194.342295:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788330194.342305:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+10:14392:x1875199750396800:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788330194.342321:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788330194.342401:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788330194.342488:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+10:14392:x1875199750396800:12345-0@lo:256:mount.lustre.0 Request processed in 184us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330194.342495:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788330194.342653:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788330194.349153:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788330194.349193:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.349206:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330194.349215:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954683588800 from 1 10000000:01000000:1.0:1788330194.349218:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330194.349264:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.349271:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.349280:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.349305:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330194.349470:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.350079:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330194.350140:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750396928 00000100:00100000:0.0:1788330194.350148:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750396928 00000100:00100000:0.0:1788330194.350195:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330194.350205:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+10:14392:x1875199750396928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330194.350218:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330194.350237:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab8ac expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.350261:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.350272:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.350281:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface600, rc 0) 00000100:00100000:0.0:1788330194.350345:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750396928:12345-0@lo:101:mount.lustre.0 Request processed in 141us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.350351:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788330194.350495:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750396928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330194.350511:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.350604:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330194.350671:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.350716:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.350736:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330194.350905:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397056 00000100:00100000:0.0:1788330194.350924:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397056 00000100:00100000:0.0:1788330194.350947:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330194.350953:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750397056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330194.351363:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750397056:12345-0@lo:501:mount.lustre.0 Request processed in 408us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.351370:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330194.351584:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.351614:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330194.351656:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.351678:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330194.351732:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397184 00000100:00100000:0.0:1788330194.351737:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397184 00000100:00100000:0.0:1788330194.351757:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788330194.351763:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750397184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330194.352078:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750397184:12345-0@lo:503:mount.lustre.0 Request processed in 314us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.352086:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788330194.352197:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330194.355169:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14435:1875199750397312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330194.355269:0:14435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330194.355308:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.355486:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397312 00000100:00100000:2.0:1788330194.355495:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397312 00000100:00100000:3.0:1788330194.355757:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330194.355768:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14435:x1875199750397312:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330194.356207:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14435:x1875199750397312:12345-0@lo:502:llog_process_th.0 Request processed in 440us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330194.356215:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330194.356422:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14435:1875199750397312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330194.356462:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.356473:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.356476:0:14435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788330194.356485:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff954683588800 00000020:00000080:1.0:1788330194.356488:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330194.356499:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.356501:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.356503:0:14435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788330194.356506:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.356508:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.356509:0:14435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788330194.356513:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff954683588800 00000020:00000080:1.0:1788330194.361825:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788330194.362096:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.362127:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.362130:0:14435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788330194.362134:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788330194.362139:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.362140:0:14435:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788330194.362145:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff954683588800 00000020:00000080:1.0:1788330194.362148:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788330194.364077:0:14435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14435:1875199750397440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330194.365489:0:14435:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.365568:0:14435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78540 going to sleep for 11 seconds 00000100:00100000:3.0:1788330194.367146:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397440 00000100:00100000:3.0:1788330194.367162:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397440 00000100:00100000:3.0:1788330194.367225:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788330194.367235:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14435:x1875199750397440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330194.367487:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14435:x1875199750397440:12345-0@lo:502:llog_process_th.0 Request processed in 253us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330194.367496:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788330194.367726:0:14435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14435:1875199750397440:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788330194.367764:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788330194.367772:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330194.367775:0:14435:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788330194.367779:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788330194.368010:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788330194.368031:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788330194.368054:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.368067:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330194.368129:0:14392:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788330194.368132:0:14392:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff954683588800 10000000:01000000:0.0:1788330194.368135:0:14392:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff954683588800 10000000:01000000:0.0:1788330194.368140:0:14392:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330194.368146:0:14392:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff954683588800 from 1 10000000:01000000:0.0:1788330194.368149:0:14392:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788330194.368183:0:14392:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.368198:0:14392:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.368208:0:14392:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330194.368228:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397568:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330194.368267:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.368305:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330194.369708:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397568 00000100:00100000:1.0:1788330194.369722:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397568 00000100:00100000:1.0:1788330194.369781:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788330194.369792:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750397568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330194.369808:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330194.369825:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a509800/0x91094de4de9ab8c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab8ba expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.369851:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a509800/0x91094de4de9ab8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab8ba expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.369861:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a509800/0x91094de4de9ab8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8ba expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.369871:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509800, rc 0) 00000100:00100000:1.0:1788330194.371258:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14392:x1875199750397568:12345-0@lo:101:mount.lustre.0 Request processed in 1458us (2980us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.371269:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788330194.371419:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397568:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330194.371444:0:14392:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8c1 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.371456:0:14392:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab8c1 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330194.371570:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330194.371608:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.371647:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571900 going to sleep for 11 seconds 00000100:00100000:1.0:1788330194.374199:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397696 00000100:00100000:1.0:1788330194.374217:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397696 00000100:00100000:1.0:1788330194.374277:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330194.374289:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14392:x1875199750397696:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.374643:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14392:x1875199750397696:12345-0@lo:501:mount.lustre.0 Request processed in 356us (3033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.374653:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788330194.375631:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397696:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330194.375700:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330194.375767:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.375804:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff954682f80c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330194.375823:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397824 00000100:00100000:1.0:1788330194.375829:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397824 00000100:00100000:1.0:1788330194.375865:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788330194.375872:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14392:x1875199750397824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330194.377508:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14392:x1875199750397824:12345-0@lo:503:mount.lustre.0 Request processed in 1627us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.377537:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788330194.377658:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750397824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330194.380756:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14438:1875199750397952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330194.380850:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330194.380902:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788330194.381021:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750397952 00000100:00100000:1.0:1788330194.381030:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750397952 00000100:00100000:1.0:1788330194.381081:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788330194.381092:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14438:x1875199750397952:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788330194.381385:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14438:x1875199750397952:12345-0@lo:502:llog_process_th.0 Request processed in 294us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330194.381399:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788330194.381580:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14438:1875199750397952:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788330194.381644:0:14438:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788330194.381660:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9546a0744d28) 00000020:00000080:3.0:1788330194.381679:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788330194.381760:0:14438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff954683588800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788330194.381764:0:14438:0:(tgt_mount.c:187:server_put_mount()) put mount ffff954683588800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788330194.381767:0:14438:0:(obd_mount.c:710:lustre_put_lsi()) put ffff954683588800 4 00010000:00080000:3.0:1788330194.381803:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff95469832c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788330194.383654:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788330194.383902:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788330194.383941:0:14438:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330194.383958:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x91094de4de9ab8cf 00000100:00080000:3.0:1788330194.383969:0:14438:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330194.383974:0:14438:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95469832c000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788330194.384016:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469be20700 x1875199750398080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330194.384054:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788330194.384337:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750398080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788330194.384425:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330194.393357:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398080 00000100:00100000:3.0:1788330194.393374:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398080 00000100:00100000:3.0:1788330194.393418:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330194.393428:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875199750398080:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788330194.393560:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3311:x1875199750398080:12345-0@lo:38:llog_process_th.0 Request processed in 130us (9133us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788330194.393567:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330194.394182:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330194.394195:0:3311:0:(import.c:65:import_set_state_nolock()) ffff95469832c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330194.394200:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788330194.394204:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750398080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788330194.398144:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14438:1875199750398208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330194.398240:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330194.398278:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398208 00000100:00100000:3.0:1788330194.398286:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398208 00000100:00100000:3.0:1788330194.398341:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330194.398351:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14438:x1875199750398208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788330194.398603:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14438:x1875199750398208:12345-0@lo:502:llog_process_th.0 Request processed in 253us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330194.398611:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788330194.398658:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330194.398691:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0d3423e3-6627-4c3c-887c-947ddc53be01:14438:1875199750398208:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788330194.398727:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788330194.399396:0:14392:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788330194.399417:0:14392:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788330194.399439:0:14392:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8c1 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330194.399450:0:14392:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacf200/0x91094de4de9ab8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8c1 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788330194.399495:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788330194.399497:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788330194.399499:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330194.399500:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330194.399501:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330194.399503:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330194.399504:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330194.399506:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788330194.399508:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330194.399509:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330194.399513:0:14392:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788330194.399533:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330194.399535:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788330194.399536:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330194.399538:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330194.399539:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330194.399540:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330194.399541:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330194.399542:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788330194.399544:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330194.399545:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788330194.399563:0:14392:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788330194.399575:0:14392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750398336:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330194.399621:0:14392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330194.399644:0:14392:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468ab34300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330194.402096:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398336 00000100:00100000:3.0:1788330194.402109:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398336 00000100:00100000:3.0:1788330194.402174:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788330194.402185:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14392:x1875199750398336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788330194.402229:0:14404:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788330194.402242:0:14404:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788330194.514887:0:14404:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788330194.514919:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788330194.515497:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788330194.515505:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788330194.515581:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.515603:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab89e expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.515611:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.515656:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9ab89e expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330194.515673:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9ab89e expref: 12 pid: 14405 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330194.515913:0:14425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1875199750398464:0@lo:104: 00000100:00100000:3.0:1788330194.516434:0:14425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330194.516494:0:14425:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469be7b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330194.516674:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398464 00000100:00100000:2.0:1788330194.516698:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398464 00000100:00100000:2.0:1788330194.516753:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330194.516764:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14425:x1875199750398464:12345-0@lo:104: 00010000:00010000:2.0:1788330194.516778:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330194.516853:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788330194.516859:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14425:x1875199750398464:12345-0@lo:104: Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330194.516866:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788330194.517055:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330194.517063:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517072:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9600 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788330194.517076:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517094:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330194.517101:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330194.517107:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330194.517158:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517164:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330194.517186:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517193:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9600/0x91094de4de9ab89e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8a5 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517213:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330194.517215:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330194.517217:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330194.517241:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750398592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330194.517286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330194.517373:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398592 00000100:00100000:0.0:1788330194.517377:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398592 00010000:00010000:0.0:1788330194.517395:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab89e expref: 13 pid: 14405 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330194.517414:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330194.517421:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+13:3315:x1875199750398592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330194.517436:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330194.517441:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab89e expref: 13 pid: 14405 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517452:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9ab89e expref: 13 pid: 14405 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517468:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517476:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788330194.517490:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001986939s 00010000:00010000:0.0:1788330194.517495:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517502:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517509:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517515:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517556:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330194.517561:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517567:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517582:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517592:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330194.517621:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+13:3315:x1875199750398592:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330194.517628:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330194.517693:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750398592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330194.517729:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a508800/0x91094de4de9ab8a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9ab89e expref: 12 pid: 14405 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330194.517739:0:14425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1875199750398464:0@lo:104: 00010000:00010000:0.0:1788330194.517755:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517764:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517769:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330194.517775:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bf7d8000/0x91094de4de9ab8d6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330194.545609:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14392:x1875199750398336:12345-0@lo:253:mount.lustre.0 Request processed in 143411us (145972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330194.545629:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330194.549321:0:14392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:14392:1875199750398336:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788330194.549467:0:14392:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788330194.549471:0:14392:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788330194.549473:0:14392:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788330194.549475:0:14392:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330194.549476:0:14392:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330194.549478:0:14392:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330194.549479:0:14392:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330194.549481:0:14392:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788330194.549483:0:14392:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788330194.549485:0:14392:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330194.549486:0:14392:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788330194.549505:0:14392:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788330194.565498:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788330194.565887:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788330194.566458:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788330194.566665:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788330194.567872:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788330194.568294:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788330194.575173:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788330194.575392:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788330194.576233:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788330194.576699:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788330194.581792:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788330194.586779:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788330194.699457:0:14392:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1788330194.700637:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788330194.700825:0:14446:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788330194.700829:0:14446:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788330194.701228:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788330194.701320:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330194.704780:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788330194.704895:0:14447:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788330194.704901:0:14447:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788330194.708282:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788330194.708421:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788330194.712041:0:14392:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788330194.712072:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788330194.712651:0:14392:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330194.716463:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788330194.718440:0:14392:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788330194.718511:0:14392:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788330194.725215:0:14392:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788330194.737088:0:14392:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788330194.855356:0:14392:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788330194.855398:0:14392:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa444817b3988 00100000:10000000:1.0:1788330194.855408:0:14392:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788330194.858440:0:14392:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788330194.858461:0:14392:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.147@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788330194.858473:0:14392:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788330194.858504:0:14392:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788330194.987015:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330195.166576:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788330195.166585:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954683588800 from 6 10000000:01000000:2.0:1788330195.166590:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330195.166637:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.166651:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330195.166664:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330195.166688:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750398720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330195.166748:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330195.166816:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bfb71540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330195.166930:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398720 00000100:00100000:0.0:1788330195.166944:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398720 00000100:00100000:0.0:1788330195.166997:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788330195.167006:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14407:x1875199750398720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330195.167019:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330195.167030:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab8dd expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.167053:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.167063:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.167072:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacee00, rc 0) 00000100:00100000:0.0:1788330195.167121:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750398720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330195.167127:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788330195.167171:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750398720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330195.167183:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.167192:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330195.167234:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750398848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788330195.167260:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330195.167273:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546835710c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330195.167284:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398848 00000100:00100000:0.0:1788330195.167292:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398848 00000100:00100000:0.0:1788330195.167311:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788330195.167316:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a24f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750398848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330195.167328:0:14404:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330195.167342:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330195.167344:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1788330195.167407:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a24f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750398848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 90us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330195.167413:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788330195.167438:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750398848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788330195.167473:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788330195.167479:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330195.167486:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330195.493262:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330196.012136:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788330196.512396:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788330197.022815:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330198.047394:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330199.071020:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330199.710739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330199.710747:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330199.710750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330199.710753:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330199.710756:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788330199.710759:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788330199.710772:0:8:0:(import.c:65:import_set_state_nolock()) ffff95469832c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788330199.710787:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff95469832c000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788330199.710811:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469be20e00 x1875199750399104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330199.710863:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330199.710877:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750398976:0@lo:400:kworker.0 00000100:00100000:3.0:1788330199.711001:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330199.711075:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750399104:0@lo:38:kworker.0 00000100:00100000:3.0:1788330199.711113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330199.711309:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750398976 00000100:00100000:0.0:1788330199.711319:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750398976 00000100:00100000:0.0:1788330199.711374:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330199.711384:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a24f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:3313:x1875199750398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330199.711441:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a24f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:3313:x1875199750398976:12345-0@lo:400:kworker.0 Request processed in 58us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.711448:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788330199.711539:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788330199.711895:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750399104 00000100:00100000:0.0:1788330199.711901:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750399104 00000100:00100000:0.0:1788330199.711930:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330199.711935:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875199750399104:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788330199.711960:0:14411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:0.0:1788330199.712002:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x91094de4de9ab8eb 00000004:00100000:0.0:1788330199.712016:0:14411:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788330199.712183:0:14411:0:(import.c:65:import_set_state_nolock()) ffff9546a2733800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330199.712226:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875199750399104:12345-0@lo:38:kworker.0 Request processed in 290us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330199.712233:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788330199.712372:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95469be20e00 x1875199750399104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330199.712386:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788330199.712394:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788330199.712398:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788330199.712400:0:3311:0:(import.c:65:import_set_state_nolock()) ffff95469832c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788330199.712414:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875199750399104:0@lo:38:kworker.0 00010000:00010000:1.0:1788330200.094699:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788330200.218667:0:14690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788330201.121499:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330202.146274:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330203.167649:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788330203.426477:0:14841:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3be67bb0 20000000:00000080:1.0:1788330203.426498:0:14841:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9546a1170800 uarg=0000000000000000 20000000:01000000:0.0:1788330203.426996:0:14841:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788330203.427005:0:14841:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788330203.427010:0:14841:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788330203.427858:0:14842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788330203.428044:0:14841:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788330203.434774:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330203.435049:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.435071:0:14841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.435081:0:14841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.435129:0:14841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.435147:0:14841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 11 pid: 14404 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330203.435163:0:14841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14841:1875199750399232:0@lo:104: 00000100:00100000:1.0:1788330203.435265:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330203.435336:0:14841:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a2e28240 going to sleep for 11 seconds 00000100:00100000:0.0:1788330203.435510:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750399232 00000100:00100000:0.0:1788330203.435554:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750399232 00000100:00100000:0.0:1788330203.435604:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330203.435614:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14841:x1875199750399232:12345-0@lo:104: 00010000:00010000:0.0:1788330203.435628:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.435685:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788330203.435692:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14841:x1875199750399232:12345-0@lo:104: Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330203.435698:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330203.439603:0:14841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14841:1875199750399232:0@lo:104: 00010000:00010000:1.0:1788330203.439637:0:14841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.439826:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330203.439834:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.439844:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508e00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788330203.439849:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.439859:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330203.439866:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330203.439872:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788330203.439935:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.439942:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788330203.439996:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750399360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788330203.440076:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788330203.440144:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.440152:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468a508e00/0x91094de4de9ab8ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8b3 expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330203.440168:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330203.440170:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330203.440172:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330203.442145:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750399360 00000100:00100000:2.0:1788330203.442158:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750399360 00010000:00010000:2.0:1788330203.442197:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 12 pid: 14404 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.442256:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330203.442267:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:3313:x1875199750399360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788330203.442281:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330203.442287:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 12 pid: 14404 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442300:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 12 pid: 14404 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442317:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bface600/0x91094de4de9ab8b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9ab8ac expref: 12 pid: 14404 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442333:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442341:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442359:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442366:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442388:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442394:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442400:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330203.442405:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442413:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442434:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330203.442453:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788330203.442487:0:14841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.442496:0:14841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330203.442513:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a508c00/0x91094de4de9ab8f2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330203.442953:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+11:3313:x1875199750399360:12345-0@lo:103:ldlm_bl.0 Request processed in 687us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330203.442960:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330203.443477:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750399360:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330204.192185:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788330204.830942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330204.830950:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330204.830952:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330204.830955:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330204.831023:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750399616:0@lo:400:kworker.0 00000100:00100000:3.0:1788330204.831137:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330204.831210:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330204.831217:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750399488:0@lo:400:kworker.0 00000100:00100000:3.0:1788330204.831247:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330204.831310:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750399616 00000100:00100000:3.0:1788330204.831319:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750399616 00000100:00100000:3.0:1788330204.831380:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330204.831390:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750399616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330204.831450:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750399616:12345-0@lo:400:kworker.0 Request processed in 61us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330204.831457:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330204.831485:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750399488 00000100:00100000:3.0:1788330204.831489:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750399488 00000100:00100000:3.0:1788330204.831512:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330204.831545:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+11:3315:x1875199750399488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330204.831574:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+11:3315:x1875199750399488:12345-0@lo:400:kworker.0 Request processed in 57us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330204.831581:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330204.832058:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750399488:0@lo:400:kworker.0 00010000:00080000:3.0:1788330204.832073:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95469be22a00 x1875199750399616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330204.832084:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750399616:0@lo:400:kworker.0 00000100:00100000:3.0:1788330204.833004:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330194/real 1788330194] req@ffff9546b4bf8e00 x1875199750396416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330204.833033:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9546b4bf8e00 x1875199750396416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330204 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330204.833044:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330194/real 1788330194] req@ffff95469be20380 x1875199750396288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330204 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330204.833053:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff95469be20380 x1875199750396288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330204 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330204.833065:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330204.833086:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330204.833090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750396416:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788330204.833094:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546b175e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330204.833098:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330204.833101:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750396288:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788330204.833260:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330204.833273:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788330204.833286:0:8:0:(import.c:65:import_set_state_nolock()) ffff9546b175e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330204.833290:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:0.0:1788330204.833295:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788330204.833300:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9546b175e000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:0.0:1788330204.833328:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546bf811c00 x1875199750399744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788330204.833349:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330204.833352:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788330204.833353:0:8:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788330204.833356:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:0.0:1788330204.833359:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788330204.833362:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9546a1ee2000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:0.0:1788330204.833373:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546bf811f80 x1875199750399872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788330204.833472:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750399744:0@lo:8:kworker.0 00000400:00000100:3.0:1788330204.833543:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199750399744 offset 0 length 520: 4 00000100:00100000:3.0:1788330204.833572:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750399872:0@lo:8:kworker.0 00000400:00000100:3.0:1788330204.833590:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875199750399872 offset 0 length 520: 4 10000000:01000000:1.0:1788330205.214651:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788330205.214661:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954683588800 from 10 10000000:01000000:1.0:1788330205.214667:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788330205.214728:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.214741:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330205.214753:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330205.214777:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750400000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788330205.214843:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330205.214895:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a2e283c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788330205.215812:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330205.215907:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400000 00000100:00100000:0.0:1788330205.215915:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400000 00000100:00100000:0.0:1788330205.217864:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788330205.217891:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+11:14407:x1875199750400000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330205.217910:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330205.217931:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab8f9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.217959:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.218003:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330205.218021:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf000, rc 0) 00000100:00100000:0.0:1788330205.218113:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750400000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (3269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330205.218441:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750400000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330205.218461:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330205.218471:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330205.218564:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750400128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330205.218601:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330205.218634:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a3e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330205.222122:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400128 00000100:00100000:2.0:1788330205.222408:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400128 00000100:00100000:0.0:1788330205.227545:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788330205.235482:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788330205.235513:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750400128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330205.235997:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750400128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 499us (17394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330205.236007:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788330205.236498:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750400128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788330205.236574:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750400256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330205.236622:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330205.236665:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a3e1d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330205.237806:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400256 00000100:00100000:2.0:1788330205.237829:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400256 00000100:00100000:2.0:1788330205.237884:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788330205.237892:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750400256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330205.238154:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+12:14407:x1875199750400256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330205.238161:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788330205.248774:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750400256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788330205.253007:0:14908:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788330205.255415:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788330205.255438:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330205.255449:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330205.255462:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330206.242801:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330206.754327:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330207.270086:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330208.286654:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788330208.638485:0:15090:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788330208.638490:0:15090:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788330208.638936:0:15090:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff95469832e800 00000020:01000004:3.0:1788330208.638955:0:15090:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788330208.638969:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788330208.638994:0:15090:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9546a0743370) 00000020:00000080:3.0:1788330208.639012:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788330208.685229:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788330208.686076:0:15090:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788330208.687439:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788330208.687879:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788330208.688121:0:15090:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788330208.688887:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 557: rc = 0 00100000:10000000:2.0:1788330208.689061:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 557: rc = 0 00100000:10000000:2.0:1788330208.689163:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 557: rc = 0 00100000:10000000:2.0:1788330208.690040:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 452: rc = 0 00100000:10000000:2.0:1788330208.690498:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 452: rc = 0 00100000:10000000:2.0:1788330208.691026:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 452: rc = 0 00100000:10000000:3.0:1788330208.693079:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 452: rc = 0 00100000:10000000:3.0:1788330208.693553:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 452: rc = 0 00100000:10000000:3.0:1788330208.693974:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 452: rc = 0 00000020:00000080:3.0:1788330208.696142:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788330208.696165:0:15090:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788330208.696177:0:15090:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x91094de4de9ab90e 00000020:01000004:3.0:1788330208.696186:0:15090:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788330208.696210:0:15090:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.147@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788330208.696213:0:15090:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788330208.696219:0:15090:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788330208.696223:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788330208.696235:0:15090:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9546a07419b8) 00000020:00000080:3.0:1788330208.696244:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788330208.700215:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330208.700436:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788330208.700444:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788330208.704857:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788330208.704873:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788330208.705229:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788330208.705236:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788330208.712081:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788330208.713016:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788330208.713023:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788330208.715025:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788330208.715038:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788330208.748940:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788330208.749191:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788330208.749197:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788330208.750438:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788330208.750447:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788330208.751960:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788330208.751971:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788330208.753951:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330208.754181:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788330208.754195:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788330208.755014:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788330208.755021:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788330208.790881:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788330208.791259:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788330208.791266:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788330208.792468:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788330208.792478:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788330208.793129:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788330208.793155:0:15090:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788330208.793162:0:15090:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.147@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788330208.810405:0:15090:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788330208.810451:0:15090:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.147@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788330208.810457:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788330208.810459:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788330208.810460:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330208.810461:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330208.810462:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330208.810464:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330208.810465:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330208.810467:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330208.810469:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788330208.810473:0:15090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788330208.810475:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788330208.810476:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788330208.810478:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330208.810479:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330208.810480:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330208.810481:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330208.810482:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330208.810488:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330208.810490:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788330208.810787:0:15090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788330208.810813:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788330208.810895:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.811101:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a4239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330208.811265:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400384 00000100:00100000:2.0:1788330208.811275:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400384 00000100:00100000:2.0:1788330208.811371:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788330208.811383:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:15090:x1875199750400384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788330208.811429:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788330208.811433:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788330208.811437:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788330208.822403:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:15090:x1875199750400384:12345-0@lo:253:mount.lustre.0 Request processed in 11012us (11497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330208.822420:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788330208.822570:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400384:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788330208.822586:0:15090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788330208.822589:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788330208.822591:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788330208.822592:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330208.822593:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330208.822594:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330208.822595:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330208.822597:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330208.822599:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330208.822600:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788330208.822621:0:15090:0:(tgt_mount.c:101:server_register_mount()) register mount ffff95469832e800 from lustre-OST0000 10000000:01000000:0.0:1788330208.822658:0:15090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788330208.822661:0:15090:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788330208.822668:0:15090:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9545850519b8 local copy 00010000:00010000:0.0:1788330208.822679:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330208.822915:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330208.822950:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.822999:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423300 going to sleep for 11 seconds 00000100:00100000:3.0:1788330208.823461:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400512 00000100:00100000:3.0:1788330208.823470:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400512 00000100:00100000:3.0:1788330208.823534:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788330208.823544:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:15090:x1875199750400512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330208.823729:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+12:15090:x1875199750400512:12345-0@lo:501:mount.lustre.0 Request processed in 186us (777us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330208.823737:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788330208.824196:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400512:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788330208.824218:0:15090:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788330208.824401:0:15090:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788330208.824410:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.824421:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330208.824458:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff95469832e800 10000000:01000000:2.0:1788330208.824463:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788330208.824468:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9545850519b8 10000000:01000000:2.0:1788330208.824470:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788330208.824474:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9545850519b8 from 1 10000000:01000000:2.0:1788330208.824476:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788330208.824508:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.824544:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.824554:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330208.824569:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400640:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330208.824610:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.824697:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330208.825854:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400640 00000100:00100000:3.0:1788330208.825866:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400640 00000100:00100000:3.0:1788330208.826038:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788330208.826050:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+12:15090:x1875199750400640:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330208.826065:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330208.826083:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d8200/0x91094de4de9ab923 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab91c expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.826119:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d8200/0x91094de4de9ab923 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab91c expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.826129:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d8200/0x91094de4de9ab923 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab91c expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.826137:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d8200, rc 0) 00000100:00100000:3.0:1788330208.826204:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+13:15090:x1875199750400640:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1593us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.826211:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788330208.826298:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400640:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330208.826314:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab923 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.826323:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab923 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330208.826342:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788330208.826361:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab923 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.826382:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468c2db800/0x91094de4de9ab91c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab923 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330208.826389:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788330208.826394:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330208.826399:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788330208.826402:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788330208.826426:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.826434:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.826442:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330208.826458:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330208.826485:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.827334:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330208.827441:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400768 00000100:00100000:1.0:1788330208.827448:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400768 00000100:00100000:1.0:1788330208.827863:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788330208.827883:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+13:15090:x1875199750400768:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330208.827898:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330208.827913:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508000/0x91094de4de9ab931 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab92a expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330208.827936:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508000/0x91094de4de9ab931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab92a expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330208.827946:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508000/0x91094de4de9ab931 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab92a expref: 14 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330208.827953:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508000, rc 0) 00000100:00100000:1.0:1788330208.828044:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750400768:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330208.828051:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788330208.828628:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330208.828657:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab931 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.828668:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab931 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330208.829754:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788330208.832384:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330208.832704:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788330208.832750:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788330208.832784:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788330208.832832:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788330208.832867:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788330208.832898:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788330208.832967:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788330208.832988:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788330208.837237:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330208.837314:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.837504:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330208.837820:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750400896 00000100:00100000:0.0:1788330208.837829:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750400896 00000100:00100000:3.0:1788330208.837917:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788330208.837930:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750400896:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330208.839499:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750400896:12345-0@lo:501:mount.lustre.0 Request processed in 1566us (2178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.839512:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788330208.850233:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750400896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330208.850342:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330208.850429:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.853732:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330208.854332:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401024 00000100:00100000:1.0:1788330208.854344:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401024 00000100:00100000:1.0:1788330208.854412:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788330208.854423:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401024:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330208.854911:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401024:12345-0@lo:503:mount.lustre.0 Request processed in 488us (4480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330208.854920:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788330208.855178:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401024:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330208.855932:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330208.856146:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401152:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330208.856210:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.856255:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330208.856413:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401152 00000100:00100000:0.0:1788330208.856420:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401152 00000100:00100000:0.0:1788330208.856467:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788330208.856476:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330208.856762:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401152:12345-0@lo:502:mount.lustre.0 Request processed in 286us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330208.856769:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788330208.857217:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401152:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330208.857511:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788330208.857586:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788330208.857622:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788330208.857665:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788330208.857696:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788330208.857723:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788330208.857779:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788330208.857810:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788330208.857835:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788330208.857870:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788330208.857897:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788330208.857932:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788330208.857967:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401280:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330208.858828:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.858921:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330208.859085:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401280 00000100:00100000:0.0:1788330208.859093:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401280 00000100:00100000:0.0:1788330208.859182:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788330208.859193:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401280:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330208.859440:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401280:12345-0@lo:502:mount.lustre.0 Request processed in 248us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330208.859448:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788330208.859596:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401280:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330208.859707:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788330208.859722:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788330208.861463:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788330208.861474:0:15104:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788330208.861480:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788330208.861483:0:15104:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788330208.861490:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788330208.861505:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9546b4a8b370) 00000020:00000080:1.0:1788330208.861553:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788330208.861571:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788330208.861639:0:15104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95469832e800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788330208.861647:0:15104:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788330208.861656:0:15104:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x91094de4de9ab93f 00010000:00010000:1.0:1788330208.864845:0:15104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788330208.870212:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788330208.872852:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788330208.878011:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788330208.881899:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330208.881921:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330208.881924:0:15104:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788330208.881931:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788330208.881934:0:15104:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1788330208.881936:0:15104:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330208.881938:0:15104:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788330208.881939:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788330208.881942:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330208.881943:0:15104:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788330208.881946:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330208.881949:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330208.881950:0:15104:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788330208.881954:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788330208.881956:0:15104:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788330208.881959:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330208.881961:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330208.881963:0:15104:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788330208.881965:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788330208.881999:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330208.882001:0:15104:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788330208.882006:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788330208.883297:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788330208.883309:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330208.883312:0:15104:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788330208.883318:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788330208.884661:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788330208.884702:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788330208.884726:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab931 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330208.884739:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468c2dae00/0x91094de4de9ab92a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab931 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330208.884749:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95469832e800 from 1 10000000:01000000:0.0:1788330208.884752:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330208.884795:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330208.884803:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330208.884815:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330208.884857:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401408:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330208.884927:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.884970:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330208.885495:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401408 00000100:00100000:1.0:1788330208.885506:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401408 00000100:00100000:1.0:1788330208.885613:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788330208.885624:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+14:15090:x1875199750401408:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330208.885642:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330208.885659:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab946 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330208.885688:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab946 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330208.885699:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab946 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330208.885708:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508200, rc 0) 00000100:00100000:1.0:1788330208.885770:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401408:12345-0@lo:101:mount.lustre.0 Request processed in 147us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330208.885777:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788330208.886164:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401408:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330208.886181:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330208.886320:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330208.896411:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788330208.896956:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330208.897796:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788330208.897855:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788330208.897923:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788330208.897950:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788330208.899364:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401536:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330208.899444:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330208.899509:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a1e3c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788330208.901298:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401536 00000100:00100000:1.0:1788330208.901315:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401536 00000100:00100000:1.0:1788330208.901425:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788330208.901436:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401536:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330208.901820:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401536:12345-0@lo:501:mount.lustre.0 Request processed in 385us (2374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330208.901830:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788330208.903469:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401536:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330208.903577:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401664:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330208.903665:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.903706:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330208.903915:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401664 00000100:00100000:2.0:1788330208.903923:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401664 00000100:00100000:2.0:1788330208.903959:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788330208.903968:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401664:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330208.904437:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401664:12345-0@lo:503:mount.lustre.0 Request processed in 468us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330208.904446:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788330208.909824:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401664:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788330208.911383:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330208.911477:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330208.911592:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.912129:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330208.912754:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401792 00000100:00100000:2.0:1788330208.912764:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401792 00000100:00100000:2.0:1788330208.912850:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788330208.912861:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330208.913300:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401792:12345-0@lo:502:mount.lustre.0 Request processed in 439us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330208.913309:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788330208.913407:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330208.913721:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788330208.913774:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788330208.913825:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788330208.913861:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788330208.913906:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788330208.913988:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788330208.914040:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788330208.914074:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788330208.914127:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401920:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330208.914178:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.914778:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788330208.914965:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750401920 00000100:00100000:3.0:1788330208.914973:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750401920 00000100:00100000:3.0:1788330208.915038:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788330208.915049:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401920:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330208.915296:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750401920:12345-0@lo:502:mount.lustre.0 Request processed in 249us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.915305:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788330208.915455:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750401920:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330208.915634:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788330208.915646:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788330208.916844:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330208.916855:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330208.916857:0:15108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788330208.916863:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95469832e800 00000020:00000080:3.0:1788330208.916871:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330208.916879:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330208.916882:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330208.916883:0:15108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788330208.916886:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330208.916888:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330208.916890:0:15108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330208.916893:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff95469832e800 00000020:00000080:3.0:1788330208.916895:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330208.916972:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330208.916986:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330208.916988:0:15108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788330208.916990:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330208.916993:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330208.916995:0:15108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330208.916998:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff95469832e800 00000020:00000080:3.0:1788330208.917000:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330208.917048:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330208.917052:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330208.917053:0:15108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788330208.917056:0:15108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788330208.918156:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788330208.918315:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330208.918336:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.918349:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330208.918414:0:15090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788330208.918416:0:15090:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff95469832e800 10000000:01000000:2.0:1788330208.918420:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff95469832e800 10000000:01000000:2.0:1788330208.918424:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788330208.918430:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff95469832e800 from 1 10000000:01000000:2.0:1788330208.918432:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788330208.918467:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.918477:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.918487:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330208.918510:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402048:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788330208.919266:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330208.919311:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689e6cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330208.919411:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402048 00000100:00100000:3.0:1788330208.919420:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402048 00000100:00100000:3.0:1788330208.919470:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788330208.919480:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750402048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788330208.919494:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330208.919510:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9ab95b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab954 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.919558:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9ab95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab954 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.919595:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bf7d9e00/0x91094de4de9ab95b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab954 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.919678:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bf7d9e00, rc 0) 00000100:00100000:3.0:1788330208.919725:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402048:12345-0@lo:101:mount.lustre.0 Request processed in 246us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.919732:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788330208.919905:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402048:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330208.919921:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab95b expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330208.919930:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab95b expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330208.931683:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788330208.935408:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788330208.936632:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788330208.936698:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788330208.936732:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788330208.936781:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788330208.936817:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788330208.936863:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788330208.936891:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788330208.936916:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788330208.936964:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788330208.937020:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788330208.937048:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788330208.937095:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788330208.937433:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788330208.937469:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788330208.937759:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788330208.937807:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788330208.937839:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788330208.937888:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788330208.937921:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788330208.937950:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788330208.939952:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788330208.940060:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788330208.940094:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788330208.940224:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788330208.940260:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788330208.940313:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788330208.940364:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788330208.940401:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788330208.940491:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788330208.940500:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788330208.941296:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330208.941375:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330208.941480:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a206000 going to sleep for 11 seconds 00000100:00100000:0.0:1788330208.951796:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402176 00000100:00100000:0.0:1788330208.951813:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402176 00000100:00100000:0.0:1788330208.951895:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330208.951907:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402176:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330208.952388:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402176:12345-0@lo:501:mount.lustre.0 Request processed in 482us (11011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330208.952397:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788330208.952746:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330208.952807:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402304:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330208.952862:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.953029:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181600 going to sleep for 11 seconds 00000100:00100000:2.0:1788330208.959727:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402304 00000100:00100000:2.0:1788330208.959743:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402304 00000100:00100000:2.0:1788330208.959804:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330208.959823:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402304:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330208.960095:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402304:12345-0@lo:503:mount.lustre.0 Request processed in 273us (7232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330208.960239:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788330208.961241:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402304:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788330208.968364:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330208.968465:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402432:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330208.968785:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330208.968834:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181900 going to sleep for 11 seconds 00000100:00100000:2.0:1788330208.968959:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402432 00000100:00100000:2.0:1788330208.968970:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402432 00000100:00100000:2.0:1788330208.969040:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788330208.969050:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402432:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330208.969320:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402432:12345-0@lo:502:mount.lustre.0 Request processed in 270us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330208.969329:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788330208.969508:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330208.970004:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788330208.970059:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788330208.970093:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788330208.970154:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788330208.970186:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788330208.970244:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788330208.970282:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788330208.970315:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788330208.970364:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788330208.970401:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788330208.970436:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788330208.970486:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788330208.970560:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788330208.970885:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788330208.970957:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788330208.971009:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788330208.971044:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788330208.971092:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788330208.971201:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788330208.971236:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788330208.971296:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788330208.971337:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788330208.971370:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788330208.971421:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788330208.971456:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788330208.971487:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788330208.971823:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788330208.971869:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788330208.971901:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788330208.971946:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788330208.972010:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788330208.972047:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788330208.972081:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788330208.972213:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788330208.972251:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788330208.972297:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788330208.972329:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788330208.972358:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788330208.972406:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788330208.972443:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788330208.972504:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402560:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330208.973013:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330208.973094:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a206540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330208.973195:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402560 00000100:00100000:2.0:1788330208.973203:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402560 00000100:00100000:2.0:1788330208.973299:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788330208.973309:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402560:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330208.973596:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402560:12345-0@lo:502:mount.lustre.0 Request processed in 288us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330208.973611:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788330208.973713:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402560:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330208.973816:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788330208.973832:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788330208.975590:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788330208.975692:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff95458650cd28) 00000020:00000080:3.0:1788330208.975715:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788330208.975808:0:15113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff95469832e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330208.975814:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff95469832e800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788330208.975817:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff95469832e800 3 00010000:00080000:3.0:1788330208.975851:0:15113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9546a1d0a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.147@tcp at head 00010000:00010000:2.0:1788330208.980006:0:15113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788330208.980346:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788330208.980399:0:15113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788330208.980430:0:15113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x91094de4de9ab969 00000100:00080000:2.0:1788330208.980446:0:15113:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788330208.980454:0:15113:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9546a1d0a000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:2.0:1788330208.980502:0:15113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff954587c48e00 x1875199750402688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330208.980584:0:15113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788330208.980739:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875199750402688:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788330208.980841:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788330208.981086:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330208.981091:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788330208.981093:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788330208.981097:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788330208.981166:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330208.981175:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750402816:0@lo:400:kworker.0 00000100:00100000:3.0:1788330208.981206:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330208.981241:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402688 00000100:00100000:3.0:1788330208.981250:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402688 00000100:00100000:3.0:1788330208.981279:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402816 00000100:00100000:3.0:1788330208.981283:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402816 00000100:00100000:3.0:1788330208.981316:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330208.981327:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750402816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330208.981380:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750402816:12345-0@lo:400:kworker.0 Request processed in 55us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.981388:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330208.981405:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330208.981409:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3311:x1875199750402688:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788330208.981429:0:14410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:3.0:1788330208.981461:0:14410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x91094de4de9ab970 00000004:00100000:3.0:1788330208.981485:0:14410:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788330208.981554:0:14410:0:(import.c:65:import_set_state_nolock()) ffff9546a1d0c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788330208.981596:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875199750402688:12345-0@lo:38:llog_process_th.0 Request processed in 185us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330208.981616:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788330208.981652:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff95469be23100 x1875199750402816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330208.981666:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750402816:0@lo:400:kworker.0 00010000:00080000:3.0:1788330208.981695:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff954587c48e00 x1875199750402688/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330208.981702:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330208.981709:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788330208.981717:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788330208.981721:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788330208.981723:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a1d0a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788330208.981730:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3311:1875199750402688:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1788330208.982915:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788330208.983234:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788330208.983262:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788330208.983314:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab95b expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330208.983327:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468c2dac00/0x91094de4de9ab954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab95b expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788330208.983386:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788330208.983389:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330208.983395:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330208.983396:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330208.983397:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330208.983399:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330208.983400:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330208.983401:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330208.983403:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788330208.983406:0:15090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788330208.983409:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788330208.983410:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330208.983411:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330208.983412:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330208.983413:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330208.983414:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330208.983415:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330208.983415:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330208.983416:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788330208.983437:0:15090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788330208.983455:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402944:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788330208.983511:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330208.983585:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a206e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788330208.985210:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750402944 00000100:00100000:1.0:1788330208.985222:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750402944 00000100:00100000:1.0:1788330208.985286:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788330208.985297:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15090:x1875199750402944:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788330208.985327:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788330208.985341:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788330209.023136:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788330209.023168:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788330209.023197:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788330209.023202:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788330209.023228:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023249:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023258:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023301:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023318:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 16 pid: 14403 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330209.023335:0:14425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1875199750403072:0@lo:104: 00000100:00100000:0.0:1788330209.023415:0:14425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330209.023457:0:14425:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788330209.023482:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403072 00000100:00100000:0.0:1788330209.023489:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403072 00000100:00100000:0.0:1788330209.023565:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330209.023588:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14425:x1875199750403072:12345-0@lo:104: 00010000:00010000:0.0:1788330209.023603:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023655:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788330209.023661:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14425:x1875199750403072:12345-0@lo:104: Request processed in 76us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330209.023690:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788330209.023719:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330209.023725:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023732:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2daa00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:0.0:1788330209.023736:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023744:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788330209.023752:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330209.023757:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788330209.023787:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023794:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788330209.023815:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023821:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468c2daa00/0x91094de4de9ab8dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab8e4 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.023836:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330209.023838:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330209.023839:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330209.023851:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750403200:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788330209.023885:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330209.023923:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403200 00000100:00100000:0.0:1788330209.023927:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403200 00010000:00010000:0.0:1788330209.023942:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 17 pid: 14403 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330209.023963:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330209.023970:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+17:3313:x1875199750403200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330209.023990:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330209.023996:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 17 pid: 14403 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024007:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 17 pid: 14403 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024022:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024031:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788330209.024043:0:14397:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001986939s 00010000:00010000:0.0:1788330209.024048:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024055:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024062:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024077:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024082:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330209.024087:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024093:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024102:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024111:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330209.024141:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+17:3313:x1875199750403200:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330209.024148:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330209.024186:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750403200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330209.024211:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bfacee00/0x91094de4de9ab8e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9ab8dd expref: 16 pid: 14403 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330209.024221:0:14425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1875199750403072:0@lo:104: 00010000:00010000:0.0:1788330209.024231:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024241:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024261:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330209.024267:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bface400/0x91094de4de9ab977 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330209.036003:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+15:15090:x1875199750402944:12345-0@lo:253:mount.lustre.0 Request processed in 50698us (52482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330209.036020:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788330209.036174:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be23100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15090:1875199750402944:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330209.036197:0:15090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788330209.036201:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330209.036203:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788330209.036204:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330209.036205:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330209.036206:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330209.036208:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330209.036209:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330209.036211:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330209.036212:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788330209.036229:0:15090:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788330209.053815:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788330209.054091:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788330209.056830:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788330209.056999:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788330209.058239:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788330209.058656:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788330209.075357:0:15090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788330209.176614:0:15090:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788330209.178591:0:15090:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788330209.178874:0:15090:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788330209.178954:0:15090:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788330209.178989:0:15090:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788330209.179019:0:15090:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788330209.315360:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788330210.142926:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788330210.142936:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954683588800 from 7 10000000:01000000:2.0:1788330210.142942:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788330210.143013:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330210.143026:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330210.143039:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330210.143070:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750403328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330210.143148:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330210.143203:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a01633c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330210.144427:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403328 00000100:00100000:1.0:1788330210.144441:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403328 00000100:00100000:1.0:1788330210.144507:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788330210.144547:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+15:14407:x1875199750403328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330210.144567:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330210.144592:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9ab97e expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330210.144620:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9ab97e expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330210.144649:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab97e expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330210.144658:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508600, rc 0) 00000100:00100000:1.0:1788330210.144735:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:14407:x1875199750403328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 218us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330210.144742:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788330210.147054:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750403328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330210.147090:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330210.147119:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330210.147211:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750403456:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788330210.147281:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330210.147322:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a01633c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330210.148090:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403456 00000100:00100000:0.0:1788330210.148099:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403456 00000100:00100000:0.0:1788330210.148143:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788330210.148152:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:14407:x1875199750403456:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788330210.148173:0:14405:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788330210.148192:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788330210.148195:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788330210.148310:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:14407:x1875199750403456:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330210.148318:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788330210.148356:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750403456:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788330210.148423:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788330210.148433:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330210.148443:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330210.334992:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330211.368816:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330212.382770:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330213.409781:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788330214.046790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330214.046798:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788330214.046801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788330214.046813:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788330214.046879:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750403840:0@lo:400:kworker.0 00000100:00100000:0.0:1788330214.046982:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330214.047232:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750403712:0@lo:400:kworker.0 00000100:00100000:3.0:1788330214.047333:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330214.047383:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788330214.047390:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750403584:0@lo:400:kworker.0 00000100:00100000:3.0:1788330214.047422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330214.047469:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403840 00000100:00100000:3.0:1788330214.047477:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403840 00000100:00100000:3.0:1788330214.049191:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403712 00000100:00100000:3.0:1788330214.049202:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403712 00000100:00100000:0.0:1788330214.054512:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330214.054538:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750403840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330214.054971:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750403840:12345-0@lo:400:kworker.0 Request processed in 438us (7988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330214.054980:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330214.055227:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330214.055239:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750403712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330214.055332:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750403712:12345-0@lo:400:kworker.0 Request processed in 97us (8066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330214.055337:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788330214.055380:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bf812300 x1875199750403712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330214.055392:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf812300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750403712:0@lo:400:kworker.0 00010000:00080000:1.0:1788330214.055748:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546bf811880 x1875199750403840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330214.055757:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750403840:0@lo:400:kworker.0 00000100:00080000:1.0:1788330214.055854:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330214.055867:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403584 00000100:00100000:1.0:1788330214.055871:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403584 00000100:00100000:1.0:1788330214.055907:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788330214.055915:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:3315:x1875199750403584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330214.055980:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:3315:x1875199750403584:12345-0@lo:400:kworker.0 Request processed in 66us (8557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330214.055988:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788330214.056435:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750403584:0@lo:400:kworker.0 00010000:00010000:3.0:1788330214.432478:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330215.455015:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330216.478831:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330216.480313:0:15457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000040:00080000:3.0:1788330216.993299:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788330217.503702:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330218.528289:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788330219.166942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330219.166948:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788330219.166951:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330219.166954:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788330219.167000:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330219.167077:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330219.167139:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788330219.167146:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750404224:0@lo:400:kworker.0 00000100:00100000:2.0:1788330219.167192:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330219.167329:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330219.167340:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750403968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330219.167377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330219.167425:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404096 00000100:00100000:3.0:1788330219.167433:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404096 00000100:00100000:3.0:1788330219.167490:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404224 00000100:00100000:3.0:1788330219.167494:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404224 00000100:00100000:3.0:1788330219.167546:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330219.167554:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750404096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330219.167608:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750404096:12345-0@lo:400:kworker.0 Request processed in 55us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330219.167614:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330219.167629:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330219.167634:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750404224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330219.167655:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750404224:12345-0@lo:400:kworker.0 Request processed in 22us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330219.167660:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788330219.167679:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788330219.167718:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff954587c48000 x1875199750404224/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330219.167731:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750404224:0@lo:400:kworker.0 00010000:00080000:3.0:1788330219.167740:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff954587c49f80 x1875199750404096/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330219.167747:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c49f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750404096:0@lo:400:kworker.0 00000100:00100000:2.0:1788330219.167870:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750403968 00000100:00100000:2.0:1788330219.167875:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750403968 00000100:00100000:2.0:1788330219.167923:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788330219.167930:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:3312:x1875199750403968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330219.167970:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+16:3312:x1875199750403968:12345-0@lo:400:kworker.0 Request processed in 41us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330219.167976:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788330219.168208:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750403968:0@lo:400:kworker.0 00000100:00100000:3.0:1788330219.230664:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330204/real 1788330204] req@ffff9546bf811c00 x1875199750399744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330219 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330219.230698:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9546bf811c00 x1875199750399744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330219 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330219.230731:0:3311:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788330204/real 1788330204] req@ffff9546bf811f80 x1875199750399872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330219 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330219.230745:0:3311:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9546bf811f80 x1875199750399872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788330219 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788330219.230766:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546b175e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330219.230841:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330219.230846:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750399744:0@lo:8:kworker.0 00000100:00080000:3.0:1788330219.230852:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330219.233282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330219.233292:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788330219.233296:0:8:0:(import.c:65:import_set_state_nolock()) ffff9546b175e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330219.233303:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1788330219.233309:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788330219.233425:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9546b175e000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:2.0:1788330219.233509:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff954587c48a80 x1875199750404352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788330219.233536:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788330219.233538:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788330219.233539:0:8:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788330219.233542:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1788330219.233544:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788330219.233549:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9546a1ee2000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:2.0:1788330219.233562:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff954587c4a300 x1875199750404480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330219.233959:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788330219.233966:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750399872:0@lo:8:kworker.0 00000100:00100000:3.0:1788330219.234005:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750404352:0@lo:8:kworker.0 00000100:00100000:3.0:1788330219.234376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330219.234489:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750404480:0@lo:8:kworker.0 00000100:00100000:3.0:1788330219.234514:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330219.234815:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404352 00000100:00100000:0.0:1788330219.234828:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404352 00000100:00100000:1.0:1788330219.234845:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404480 00000100:00100000:1.0:1788330219.234850:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404480 00000100:00100000:0.0:1788330219.234914:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330219.234923:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875199750404352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788330219.234955:0:15092:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 474 last 0 00000020:00000080:0.0:1788330219.234985:0:15092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9ab98c 00002000:00100000:0.0:1788330219.235002:0:15092:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9546a0de0800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788330219.235006:0:15092:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788330219.235009:0:15092:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788330219.235651:0:15092:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330219.235677:0:15092:0:(import.c:65:import_set_state_nolock()) ffff9546a0de3000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330219.235751:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875199750404352:12345-0@lo:8:kworker.0 Request processed in 827us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330219.235759:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788330219.235782:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330219.235786:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875199750404480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788330219.235814:0:15092:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788330219.235842:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875199750404480:12345-0@lo:8:kworker.0 Request processed in 54us (1327us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788330219.235848:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788330219.235947:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff954587c48a80 x1875199750404352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330219.235966:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330219.235974:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788330219.235982:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788330219.236052:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788330219.236055:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546b175e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788330219.236071:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788330219.236076:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750404352:0@lo:8:kworker.0 00000100:00080000:2.0:1788330219.236091:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788330219.236095:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788330219.236098:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750404480:0@lo:8:kworker.0 00000004:00080000:3.0:1788330219.236281:0:14431:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788330219.236410:0:14432:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788330219.236435:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1875199750404736:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788330219.236555:0:14431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 474149036892ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788330219.237197:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330219.237231:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0163240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330219.237244:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330219.237262:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750404608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330219.237293:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330219.237465:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404736 00000100:00100000:1.0:1788330219.237548:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404736 00000100:00100000:1.0:1788330219.237668:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788330219.237677:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1875199750404736:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788330219.237824:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404608 00000100:00100000:3.0:1788330219.237828:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404608 00000100:00100000:3.0:1788330219.237854:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330219.237861:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750404608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330219.237896:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330219.237947:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750404608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330219.237962:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788330219.241896:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788330219.241952:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfbb80 x1875199750404608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330235 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330219.241978:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750404608:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1788330219.244379:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788330219.244391:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788330219.244396:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788330219.265297:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.265312:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.265332:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.265337:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.265344:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.265366:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.265378:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.265402:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.265432:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330219.265682:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330219.265690:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.265698:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330219.265702:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.265712:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.265733:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.265740:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9ab993 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.265761:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.265763:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.265765:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.266621:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.266628:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266639:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.266643:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.266647:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266657:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266665:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266671:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266687:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.266696:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.266701:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266713:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508e00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.266717:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266724:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266735:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266742:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000783d0705/0x91094de4de9ab99a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.266753:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.266755:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.266756:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.267299:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.267305:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267315:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.267319:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.267323:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267332:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267345:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267352:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267365:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.267372:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.267377:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267383:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.267387:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267394:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267405:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267413:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9ab9a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.267425:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.267432:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.267434:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.271935:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.271950:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.271967:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.271972:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.271979:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.271994:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.272004:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.272011:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.272037:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330219.272103:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330219.272111:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.272119:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330219.272123:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.272132:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.272152:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.272160:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030f49935/0x91094de4de9ab9a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.272188:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.272190:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.272192:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.273082:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.273091:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273103:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.273107:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.273111:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273129:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273137:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273144:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273160:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.273171:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.273176:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273183:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.273186:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273193:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273204:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273210:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0eae088/0x91094de4de9ab9af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.273230:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.273232:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.273233:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.274424:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.274435:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.274449:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.274452:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.274458:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275765:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275788:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275796:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275816:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.275830:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.275836:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275856:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.275861:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275870:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275902:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275911:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afbe3221/0x91094de4de9ab9b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.275933:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.275935:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.275938:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.278346:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.278362:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278381:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.278385:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.278392:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278405:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278421:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278429:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278448:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.278465:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.278484:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278492:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.278497:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278506:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278539:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278547:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9ab9bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.278572:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.278587:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.278589:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.279161:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.279167:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279176:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.279179:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.279183:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279192:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279200:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279208:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279222:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.279231:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.279236:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279242:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.279246:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279265:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279276:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279284:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9ab9c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279296:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.279298:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.279299:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.279689:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.279695:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279703:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.279706:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.279710:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279719:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279726:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279737:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279750:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.279758:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.279761:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279768:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.279771:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279779:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279790:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279797:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9ab9cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.279809:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.279810:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.279812:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.285713:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.285734:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.285754:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.285760:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.285767:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.285785:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.285797:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.285806:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.285831:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788330219.286314:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.286321:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286340:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.286343:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.286348:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286358:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286365:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286372:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286394:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788330219.286410:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788330219.286418:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286426:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.286432:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286441:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286475:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286484:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9ab9d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286502:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330219.286505:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286511:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.286515:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286561:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286570:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286578:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9ab9d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.286590:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.286592:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.286599:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.287023:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.287029:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287038:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.287041:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.287045:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287054:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287061:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287068:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287084:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330219.287092:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330219.287095:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287101:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacee00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.287104:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287123:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287148:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287155:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9ab9e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287169:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.287170:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.287172:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.287582:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.287588:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287597:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.287600:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.287604:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287613:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287620:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287634:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287648:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330219.287657:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330219.287660:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287667:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.287670:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287677:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287687:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287693:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9ab9e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.287705:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.287707:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.287709:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.288151:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.288164:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288173:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.288176:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.288180:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288189:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288196:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288202:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288217:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330219.288225:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330219.288228:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288235:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.288238:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288246:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288264:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288271:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9ab9ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288284:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.288286:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.288288:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.288464:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.288699:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.288706:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288715:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.288718:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.288723:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288732:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288741:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288749:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.288783:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330219.288867:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330219.288873:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.288891:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330219.288901:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.288909:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.288920:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.288927:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5ca12f1/0x91094de4de9ab9f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.288940:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.288941:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.288943:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.299366:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.299383:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299403:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.299408:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.299414:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299428:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299438:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299446:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299472:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330219.299486:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330219.299494:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299501:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfe00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.299513:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299542:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299569:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299576:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9ab9fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.299595:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.299597:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.299599:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.302664:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.302678:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.302695:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.302700:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.302707:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.302725:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.302734:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.302748:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.302776:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330219.302907:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.302918:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.302926:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.302930:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.302939:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.302956:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.302963:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.302978:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.302980:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.302982:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.303299:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.303305:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303315:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.303318:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.303323:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303333:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303341:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303349:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303361:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330219.303369:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330219.303374:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303387:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330219.303390:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303397:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303408:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303415:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.303427:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.303431:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.303433:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788330219.315791:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788330219.317160:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.317172:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.317195:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.317201:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.317208:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.317225:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.317245:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.317254:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.317280:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330219.318001:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330219.318009:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.318020:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfe00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330219.318024:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.318033:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.318125:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.318134:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014b8a5b4/0x91094de4de9aba11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.318150:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.318152:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.318154:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788330219.320862:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.320875:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.320903:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.320908:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.320916:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.320943:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.320953:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.320959:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.320999:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788330219.321457:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788330219.321463:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.321472:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=474s v=(0 0) 00010000:00010000:1.0:1788330219.321476:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330219.321480:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.321488:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.321495:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.321513:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.321561:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788330219.322008:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788330219.322017:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322036:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330219.322041:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322059:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322077:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322085:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005497a41b/0x91094de4de9aba18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322103:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330219.322106:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322111:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2719600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330219.322115:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322122:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322130:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322142:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc59633e/0x91094de4de9aba1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.322158:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.322160:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.322161:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.322168:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.328488:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.328507:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.328633:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.328638:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.328644:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.328660:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.328673:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.328680:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.328722:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330219.328892:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330219.328900:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.328908:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfa00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330219.328914:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.328923:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.328942:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.328955:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd668443/0x91094de4de9aba26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.328971:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.328973:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.328975:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.329447:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.329454:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.329465:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.329468:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.329472:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.329482:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.329490:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.329498:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.329644:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788330219.330077:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.330084:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.330093:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.330101:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.330106:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.330116:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.330124:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.330131:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331330:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330219.331342:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331354:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.331358:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331366:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331386:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331392:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9aba2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331410:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.331414:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331432:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.331435:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331443:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331454:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.331462:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.331464:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.331465:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.331572:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788330219.331579:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d24ca2/0x91094de4de9aba34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.331692:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.332393:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.332402:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.332414:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.332418:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.332424:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.332436:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.332452:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.332461:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.332546:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788330219.332976:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.332982:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.333139:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.333143:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.333148:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.333158:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.333167:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.333174:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333291:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788330219.333297:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333305:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacee00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.333309:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333317:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333332:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333344:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000933168cb/0x91094de4de9aba3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333359:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330219.333363:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333370:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacfc00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330219.333373:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333381:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333390:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330219.333397:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.333399:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330219.333401:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330219.333441:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788330219.333446:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061c1c4b8/0x91094de4de9aba42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.333506:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.334006:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.334012:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.334022:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.334025:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.334030:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.334041:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.334130:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.334138:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.334162:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330219.334800:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330219.334812:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.334821:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacf400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330219.334825:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.334836:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.334856:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.334863:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a7c1146/0x91094de4de9aba49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330219.334890:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.334892:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330219.334901:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788330219.335421:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330219.335429:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.335445:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=474s v=(0 0) 00010000:00010000:0.0:1788330219.335448:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330219.335453:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.335464:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.336027:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.336036:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330219.336127:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788330219.336410:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:3.0:1788330219.336974:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330219.336984:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.337109:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330219.337115:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.337124:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.337142:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.337150:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9aba50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330219.337168:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.337175:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330219.337177:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330219.338192:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1875199750404736:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788330219.338209:0:14432:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1788330219.338254:0:14432:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1875199750404864:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788330219.338299:0:14432:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330219.338362:0:14432:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0163240 going to sleep for 11 seconds 00000100:00100000:1.0:1788330219.338385:0:15094:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788330219.338393:0:15094:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788330219.340076:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1875199750404736:12345-0@lo:5:osp-pre-0-0.0 Request processed in 98864us (99343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330219.340101:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330219.340140:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404864 00000100:00100000:0.0:1788330219.340149:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404864 00000100:00100000:0.0:1788330219.340205:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788330219.340216:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1875199750404864:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788330219.340269:0:15093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788330219.354774:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14432:x1875199750404864:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14547us (16461us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788330219.354800:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788330219.357951:0:14432:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1875199750404864:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788330219.357969:0:14432:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788330219.553053:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788330219.814314:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788330219.814350:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788330220.574630:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330221.599372:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330222.625258:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330223.649882:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788330223.781135:0:15809:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788330223.781139:0:15809:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788330223.781370:0:15809:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9546a0de1800 00000020:01000004:0.0:1788330223.781386:0:15809:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788330223.781400:0:15809:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788330223.781414:0:15809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff954691400000) 00000020:00000080:0.0:1788330223.781441:0:15809:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788330223.813124:0:15809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788330223.814932:0:15809:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788330223.817162:0:15809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788330223.817989:0:15809:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788330223.818948:0:15809:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788330223.819925:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 519: rc = 0 00100000:10000000:1.0:1788330223.820047:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 519: rc = 0 00100000:10000000:1.0:1788330223.820153:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 519: rc = 0 00100000:10000000:1.0:1788330223.821440:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 655: rc = 0 00100000:10000000:1.0:1788330223.822114:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 655: rc = 0 00100000:10000000:1.0:1788330223.823086:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 655: rc = 0 00100000:10000000:1.0:1788330223.823965:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 655: rc = 0 00100000:10000000:1.0:1788330223.824410:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 655: rc = 0 00100000:10000000:1.0:1788330223.825005:0:15809:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 655: rc = 0 00000020:00000080:1.0:1788330223.826394:0:15809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788330223.826411:0:15809:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788330223.826424:0:15809:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x91094de4de9aba5e 00000020:01000004:1.0:1788330223.826446:0:15809:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788330223.826943:0:15809:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.147@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788330223.826948:0:15809:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.147@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788330223.826955:0:15809:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788330223.826981:0:15809:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788330223.826986:0:15809:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.147@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788330223.837446:0:15809:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.147@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788330223.837714:0:15809:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.147@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1788330223.837722:0:15809:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788330223.837724:0:15809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788330223.837725:0:15809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330223.837726:0:15809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330223.837727:0:15809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330223.837729:0:15809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330223.837730:0:15809:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330223.837732:0:15809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330223.837734:0:15809:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788330223.837738:0:15809:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1788330223.837740:0:15809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788330223.837741:0:15809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788330223.837742:0:15809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788330223.837743:0:15809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788330223.837744:0:15809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788330223.837745:0:15809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788330223.837746:0:15809:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788330223.837747:0:15809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788330223.837747:0:15809:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788330223.837779:0:15809:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788330223.837805:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750404992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788330223.837893:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.838029:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788330223.838078:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750404992 00000100:00100000:0.0:1788330223.838087:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750404992 00000100:00100000:0.0:1788330223.838176:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788330223.838187:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15809:x1875199750404992:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788330223.838218:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788330223.838221:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788330223.838225:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788330223.847712:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15809:x1875199750404992:12345-0@lo:253:mount.lustre.0 Request processed in 9512us (9803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.847734:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788330223.847864:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750404992:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788330223.847884:0:15809:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788330223.847888:0:15809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788330223.847890:0:15809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788330223.847891:0:15809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788330223.847893:0:15809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788330223.847894:0:15809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788330223.847895:0:15809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788330223.847897:0:15809:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788330223.847900:0:15809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788330223.847901:0:15809:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788330223.847925:0:15809:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9546a0de1800 from lustre-OST0001 10000000:01000000:0.0:1788330223.847959:0:15809:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788330223.847962:0:15809:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788330223.847987:0:15809:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9545850519b8 local copy 00010000:00010000:0.0:1788330223.848001:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330223.848293:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405120:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330223.848339:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.848385:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330223.848872:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405120 00000100:00100000:2.0:1788330223.848882:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405120 00000100:00100000:2.0:1788330223.848939:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788330223.848949:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15809:x1875199750405120:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330223.849384:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15809:x1875199750405120:12345-0@lo:501:mount.lustre.0 Request processed in 435us (1043us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788330223.849393:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788330223.849679:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405120:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788330223.849697:0:15809:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.147@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788330223.849875:0:15809:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.147@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788330223.849884:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.849895:0:15809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468a509e00/0x91094de4de9ab804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9ab80b expref: -99 pid: 14392 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330223.849924:0:15809:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9546a0de1800 10000000:01000000:0.0:1788330223.849929:0:15809:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788330223.849934:0:15809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788330223.849937:0:15809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788330223.849941:0:15809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788330223.849944:0:15809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788330223.849970:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.849979:0:15809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.849990:0:15809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330223.850017:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405248:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330223.850058:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.850138:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788330223.850787:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405248 00000100:00100000:2.0:1788330223.850797:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405248 00000100:00100000:2.0:1788330223.850904:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788330223.850914:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+16:15809:x1875199750405248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788330223.850928:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330223.850943:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2da600/0x91094de4de9aba6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aba65 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330223.850967:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2da600/0x91094de4de9aba6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aba65 expref: 17 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330223.850977:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2da600/0x91094de4de9aba6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aba65 expref: 17 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330223.850999:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da600, rc 0) 00000100:00100000:2.0:1788330223.851056:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405248:12345-0@lo:101:mount.lustre.0 Request processed in 144us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.851063:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788330223.851139:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405248:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788330223.851154:0:15809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba6c expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.851174:0:15809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aba6c expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788330223.851884:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788330223.852758:0:15809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788330223.853033:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788330223.853081:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788330223.853115:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788330223.853163:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788330223.853203:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788330223.853237:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788330223.853306:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788330223.853314:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788330223.853410:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330223.853478:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.853943:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330223.854016:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405376 00000100:00100000:3.0:1788330223.854026:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405376 00000100:00100000:3.0:1788330223.854066:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788330223.854075:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405376:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788330223.854781:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405376:12345-0@lo:501:mount.lustre.0 Request processed in 704us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.854790:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788330223.855030:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405376:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330223.855077:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405504:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330223.855122:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.855175:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330223.855359:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405504 00000100:00100000:3.0:1788330223.855366:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405504 00000100:00100000:3.0:1788330223.855403:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788330223.855410:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788330223.855771:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405504:12345-0@lo:503:mount.lustre.0 Request processed in 360us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.855780:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788330223.855949:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405504:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788330223.856931:0:15809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788330223.857015:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330223.857073:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.857116:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330223.857355:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405632 00000100:00100000:3.0:1788330223.857363:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405632 00000100:00100000:3.0:1788330223.857410:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788330223.857419:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330223.857674:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da71050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405632:12345-0@lo:502:mount.lustre.0 Request processed in 256us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.857683:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788330223.857867:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330223.858128:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788330223.858365:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788330223.858400:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788330223.858446:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788330223.858483:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788330223.858678:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788330223.858731:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788330223.858769:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788330223.858820:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788330223.858875:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405760:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330223.858933:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.858974:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95469b79a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.859038:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405760 00000100:00100000:1.0:1788330223.859044:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405760 00000100:00100000:1.0:1788330223.859137:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788330223.859147:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330223.859506:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da70450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405760:12345-0@lo:502:mount.lustre.0 Request processed in 360us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.859538:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788330223.859765:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405760:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330223.859864:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788330223.859876:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1788330223.860930:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788330223.860943:0:15811:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788330223.860950:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788330223.860953:0:15811:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788330223.860960:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788330223.860975:0:15811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9545853099b8) 00000020:00000080:2.0:1788330223.860998:0:15811:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788330223.861003:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788330223.861071:0:15811:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9546a0de1800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788330223.861078:0:15811:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788330223.861086:0:15811:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x91094de4de9aba7a 00010000:00010000:0.0:1788330223.866291:0:15811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788330223.866831:0:15811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1788330223.868875:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788330223.879661:0:15811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788330223.879690:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330223.879697:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.879700:0:15811:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788330223.879706:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330223.879712:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.879713:0:15811:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788330223.879718:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788330223.879720:0:15811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788330223.879723:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330223.879725:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.879727:0:15811:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788330223.879729:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330223.879732:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.879733:0:15811:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788330223.879736:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788330223.879808:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330223.879812:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.879814:0:15811:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788330223.879818:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788330223.880317:0:15809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788330223.880348:0:15809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788330223.880373:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba6c expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.880395:0:15809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacf400/0x91094de4de9aba65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba6c expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330223.880404:0:15809:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9546a0de1800 from 1 10000000:01000000:0.0:1788330223.880407:0:15809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330223.880446:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.880454:0:15809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330223.880465:0:15809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330223.880492:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405888:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788330223.880589:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.880630:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b47a5780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.880697:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750405888 00000100:00100000:1.0:1788330223.880707:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750405888 00000100:00100000:1.0:1788330223.880763:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788330223.880773:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+17:15809:x1875199750405888:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330223.880795:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330223.880809:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aba81 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.880848:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aba81 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.880861:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aba81 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.880870:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2719200, rc 0) 00000100:00100000:1.0:1788330223.880923:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da71850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750405888:12345-0@lo:101:mount.lustre.0 Request processed in 151us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.880930:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788330223.880979:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750405888:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330223.880993:0:15809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.881003:0:15809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330223.881650:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788330223.884135:0:15809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330223.886740:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788330223.886804:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788330223.886917:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788330223.886927:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788330223.887042:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330223.887135:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.888435:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406016 00000100:00100000:0.0:1788330223.888450:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406016 00000100:00100000:0.0:1788330223.888537:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788330223.888549:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406016:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788330223.888874:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da71450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406016:12345-0@lo:501:mount.lustre.0 Request processed in 327us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.888882:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788330223.891426:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.891480:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406016:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788330223.891591:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406144:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330223.891676:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.891712:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788330223.891972:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406144 00000100:00100000:0.0:1788330223.891982:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406144 00000100:00100000:0.0:1788330223.892037:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788330223.892047:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406144:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788330223.892446:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da70850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406144:12345-0@lo:503:mount.lustre.0 Request processed in 399us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.892457:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788330223.892669:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406144:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788330223.894622:0:15809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788330223.894738:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330223.894819:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.894877:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330223.896392:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406272 00000100:00100000:0.0:1788330223.896411:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406272 00000100:00100000:0.0:1788330223.896489:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788330223.896500:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406272:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330223.896809:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406272:12345-0@lo:502:mount.lustre.0 Request processed in 310us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330223.896818:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788330223.897476:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788330223.897798:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788330223.897897:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788330223.897950:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788330223.897988:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788330223.898021:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788330223.898074:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788330223.898126:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788330223.900557:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788330223.900658:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406400:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788330223.900751:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.900794:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf181840 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.900896:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406400 00000100:00100000:1.0:1788330223.900905:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406400 00000100:00100000:1.0:1788330223.900961:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330223.900971:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406400:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330223.901206:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406400:12345-0@lo:502:mount.lustre.0 Request processed in 236us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.901215:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788330223.901277:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788330223.901441:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788330223.901452:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788330223.904077:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330223.904090:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.904093:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788330223.904100:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9546a0de1800 00000020:00000080:3.0:1788330223.904103:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330223.904110:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330223.904112:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.904114:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788330223.904116:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330223.904119:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.904120:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788330223.904123:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9546a0de1800 00000020:00000080:3.0:1788330223.904125:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330223.904362:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330223.904366:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.904378:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788330223.904381:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788330223.904384:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.904385:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788330223.904388:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9546a0de1800 00000020:00000080:3.0:1788330223.904391:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788330223.910671:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788330223.910688:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788330223.910691:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788330223.910696:0:15815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788330223.910914:0:15809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788330223.910942:0:15809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788330223.910963:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.910976:0:15809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330223.911028:0:15809:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788330223.911032:0:15809:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9546a0de1800 10000000:01000000:1.0:1788330223.911035:0:15809:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9546a0de1800 10000000:01000000:1.0:1788330223.911049:0:15809:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788330223.911055:0:15809:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9546a0de1800 from 1 10000000:01000000:1.0:1788330223.911058:0:15809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788330223.911095:0:15809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.911105:0:15809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.911116:0:15809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330223.911142:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406528:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788330223.911339:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.911390:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.911413:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406528 00000100:00100000:1.0:1788330223.911421:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406528 00000100:00100000:1.0:1788330223.911547:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330223.911557:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750406528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330223.911569:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330223.911581:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546a2719e00/0x91094de4de9aba96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9aba8f expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.911606:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546a2719e00/0x91094de4de9aba96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9aba8f expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.911615:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546a2719e00/0x91094de4de9aba96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aba8f expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.911624:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2719e00, rc 0) 00000100:00100000:1.0:1788330223.911672:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406528:12345-0@lo:101:mount.lustre.0 Request processed in 116us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.911679:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788330223.911736:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406528:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788330223.911753:0:15809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba96 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.911762:0:15809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9aba96 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788330223.915815:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788330223.916183:0:15809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788330223.919138:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788330223.919974:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788330223.920014:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788330223.920308:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788330223.920353:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788330223.920399:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788330223.920436:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788330223.920484:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788330223.920558:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788330223.920609:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788330223.920639:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788330223.920681:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788330223.920712:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788330223.920744:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788330223.920786:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788330223.920817:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788330223.923312:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788330223.923434:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788330223.923489:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788330223.923558:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788330223.923721:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788330223.923760:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788330223.923793:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788330223.923866:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788330223.923905:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788330223.923940:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788330223.924077:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788330223.924109:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788330223.924143:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788330223.924195:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788330223.924233:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788330223.924267:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788330223.924303:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788330223.924352:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788330223.924393:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788330223.924445:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788330223.924497:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788330223.924720:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788330223.924731:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788330223.924880:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330223.924957:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.925008:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406656 00000100:00100000:2.0:1788330223.925016:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406656 00000100:00100000:2.0:1788330223.925070:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788330223.925080:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406656:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330223.925339:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406656:12345-0@lo:501:mount.lustre.0 Request processed in 258us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.925348:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788330223.925388:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a443780 going to sleep for 11 seconds 00000100:00100000:2.0:1788330223.925411:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788330223.925442:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406784:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788330223.925489:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.925514:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a443780 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.925727:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406784 00000100:00100000:1.0:1788330223.925733:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406784 00000100:00100000:1.0:1788330223.925768:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330223.925775:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406784:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788330223.926144:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406784:12345-0@lo:503:mount.lustre.0 Request processed in 367us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.926151:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788330223.926266:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406784:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788330223.927976:0:15809:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788330223.928075:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330223.928141:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.928328:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750406912 00000100:00100000:2.0:1788330223.928338:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750406912 00000100:00100000:2.0:1788330223.928393:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788330223.928403:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406912:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788330223.929858:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330223.932632:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750406912:12345-0@lo:502:mount.lustre.0 Request processed in 4222us (4482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330223.932654:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788330223.932982:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750406912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788330223.935208:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788330223.935296:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788330223.935315:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788330223.935342:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788330223.935372:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788330223.935399:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788330223.935443:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788330223.935480:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788330223.935563:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788330223.935604:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788330223.935638:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788330223.935708:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788330223.935729:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788330223.935746:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788330223.935770:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788330223.935787:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788330223.935803:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788330223.935872:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788330223.935896:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788330223.935912:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788330223.935937:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788330223.935964:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788330223.935995:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788330223.936035:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788330223.936056:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788330223.936072:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788330223.936109:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1788330223.936140:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1788330223.936158:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1788330223.936183:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1788330223.936208:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1788330223.936239:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1788330223.936269:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1788330223.936309:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1788330223.936331:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1788330223.936358:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1788330223.936376:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1788330223.936391:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788330223.936416:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788330223.936433:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788330223.936490:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750407040:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788330223.936610:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.936667:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b47a5f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788330223.936668:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407040 00000100:00100000:3.0:1788330223.936677:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407040 00000100:00100000:3.0:1788330223.936742:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788330223.936751:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750407040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788330223.937023:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750407040:12345-0@lo:502:mount.lustre.0 Request processed in 271us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330223.937031:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788330223.937097:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf812680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750407040:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788330223.937175:0:15809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788330223.937188:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1788330223.940488:0:15820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788330223.940510:0:15820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9546b46d3370) 00000020:00000080:1.0:1788330223.940559:0:15820:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1788330223.940666:0:15820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9546a0de1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788330223.940671:0:15820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9546a0de1800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788330223.940674:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9546a0de1800 3 00010000:00080000:1.0:1788330223.940712:0:15820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9546a0de5000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.147@tcp at head 00010000:00010000:3.0:1788330223.943019:0:15820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788330223.943254:0:15820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788330223.943302:0:15820:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788330223.943316:0:15820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x91094de4de9abaa4 00000100:00080000:3.0:1788330223.943328:0:15820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788330223.943335:0:15820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9546a0de5000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:3.0:1788330223.943385:0:15820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff95469be21500 x1875199750407168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788330223.943427:0:15820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788330223.943514:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330223.943538:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330223.943541:0:12641:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330223.943545:0:12641:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 474 00000100:00080000:1.0:1788330223.943550:0:12641:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788330223.943554:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9546a1ee2000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:1.0:1788330223.943569:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546b4bf8a80 x1875199750407424/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330223.943640:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750407296:0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.943722:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.943777:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750407680:0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.943806:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.943826:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330223.943832:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750407552:0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.943871:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.943902:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407296 00000100:00100000:1.0:1788330223.943909:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407296 00000100:00100000:1.0:1788330223.943960:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788330223.943969:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750407296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.944039:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750407296:12345-0@lo:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.944047:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330223.944066:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788330223.944070:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407680 00000100:00100000:1.0:1788330223.944073:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407680 00000100:00100000:3.0:1788330223.944085:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750407296:0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.944097:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407552 00000100:00100000:1.0:1788330223.944099:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407552 00000100:00100000:1.0:1788330223.944113:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330223.944119:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750407680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330223.944156:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3315:x1875199750407680:12345-0@lo:400:kworker.0 Request processed in 36us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.944162:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788330223.944173:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788330223.944177:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfa300 x1875199750407680/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330223.944179:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750407552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330223.944187:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3315:1875199750407680:0@lo:400:kworker.0 00000100:00100000:0.0:1788330223.945335:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750407168:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788330223.945393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330223.945425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750407424:0@lo:8:kworker.0 00000100:00100000:0.0:1788330223.945451:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330223.945703:0:15585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407424 00000100:00100000:3.0:1788330223.945712:0:15585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407424 00000100:00100000:3.0:1788330223.945746:0:15585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330223.945754:0:15585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3311:x1875199750407424:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788330223.945818:0:15585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3311:x1875199750407424:12345-0@lo:8:kworker.0 Request processed in 63us (365us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788330223.945825:0:15585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330223.945870:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788330223.945877:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788330223.945882:0:3311:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788330223.945885:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750407424:0@lo:8:kworker.0 00000100:00100000:1.0:1788330223.947463:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750407552:12345-0@lo:400:kworker.0 Request processed in 3275us (3582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.947478:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788330223.947508:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407168 00000100:00100000:1.0:1788330223.947530:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407168 00000100:00100000:1.0:1788330223.947555:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330223.947562:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3311:x1875199750407168:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788330223.947588:0:14411:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 478 last 0 00000020:00000080:1.0:1788330223.947628:0:14411:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x91094de4de9abaab 00000004:00100000:1.0:1788330223.947646:0:14411:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788330223.947649:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330223.947655:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330223.947687:0:14411:0:(import.c:65:import_set_state_nolock()) ffff954683608800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330223.947756:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875199750407168:12345-0@lo:38:llog_process_th.0 Request processed in 194us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.947769:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788330223.947797:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff95469be21500 x1875199750407168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788330233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788330223.947809:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788330223.947817:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788330223.947826:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788330223.947831:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788330223.947848:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a0de5000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788330223.947854:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3311:1875199750407168:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788330223.948226:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788330223.948294:0:15809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788330223.948328:0:15809:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788330223.948354:0:15809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba96 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330223.948365:0:15809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546a2719c00/0x91094de4de9aba8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9aba96 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788330223.948413:0:15809:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788330223.948416:0:15809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788330223.948417:0:15809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330223.948418:0:15809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330223.948420:0:15809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330223.948421:0:15809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330223.948423:0:15809:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788330223.948425:0:15809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330223.948427:0:15809:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788330223.948431:0:15809:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788330223.948438:0:15809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788330223.948439:0:15809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788330223.948440:0:15809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788330223.948441:0:15809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788330223.948442:0:15809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788330223.948443:0:15809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788330223.948444:0:15809:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788330223.948444:0:15809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788330223.948445:0:15809:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788330223.948480:0:15809:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788330223.948501:0:15809:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750407808:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788330223.948733:0:15809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330223.948774:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407808 00000100:00100000:2.0:1788330223.948779:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407808 00000100:00100000:2.0:1788330223.948821:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788330223.948829:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9545810ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:15809:x1875199750407808:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788330223.948881:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788330223.948899:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788330223.949435:0:15809:0:(client.c:2715:ptlrpc_set_wait()) set ffff954683571b40 going to sleep for 11 seconds 00010000:00080000:0.0:1788330223.951402:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9546b4bfa680 x1875199750407552/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788330223.951424:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750407552:0@lo:400:kworker.0 20000000:01000000:0.0:1788330223.994146:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788330223.994170:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788330223.994328:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788330223.994335:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788330223.994365:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994385:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab97e expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994394:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994436:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9ab97e expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994452:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9ab97e expref: 19 pid: 14403 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330223.994468:0:14425:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1875199750407936:0@lo:104: 00000100:00100000:1.0:1788330223.994635:0:14425:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.994686:0:14425:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a38ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788330223.994711:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750407936 00000100:00100000:1.0:1788330223.994717:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750407936 00000100:00100000:1.0:1788330223.994762:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330223.994771:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14425:x1875199750407936:12345-0@lo:104: 00010000:00010000:1.0:1788330223.994785:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994851:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788330223.994874:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0d3423e3-6627-4c3c-887c-947ddc53be01+3:14425:x1875199750407936:12345-0@lo:104: Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.994882:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788330223.994909:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330223.994915:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994924:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2dba00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:1.0:1788330223.994927:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.994936:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788330223.995019:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788330223.995027:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788330223.995057:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995064:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788330223.995085:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995092:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468c2dba00/0x91094de4de9ab97e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab985 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995110:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330223.995112:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330223.995114:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330223.995143:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750408064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788330223.995173:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330223.995400:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408064 00000100:00100000:1.0:1788330223.995405:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408064 00010000:00010000:1.0:1788330223.995426:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab97e expref: 20 pid: 14403 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330223.995450:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330223.995457:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+20:3312:x1875199750408064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330223.995466:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330223.995471:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab97e expref: 20 pid: 14403 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995482:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9ab97e expref: 20 pid: 14403 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995500:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995507:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788330223.995625:0:14397:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001986939s 00010000:00010000:1.0:1788330223.995631:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995638:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995645:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995661:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995667:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330223.995671:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995679:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995687:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995698:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330223.995730:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+20:3312:x1875199750408064:12345-0@lo:103:ldlm_bl.0 Request processed in 274us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330223.995738:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788330223.995783:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750408064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788330223.995810:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a508600/0x91094de4de9ab985 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9ab97e expref: 19 pid: 14403 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330223.995819:0:14425:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1875199750407936:0@lo:104: 00010000:00010000:1.0:1788330223.995832:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995855:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995871:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330223.995877:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546a2718800/0x91094de4de9abab2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330224.008100:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9545810ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+18:15809:x1875199750407808:12345-0@lo:253:mount.lustre.0 Request processed in 59259us (59355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330224.008114:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788330224.008368:0:15809:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c49c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0d3423e3-6627-4c3c-887c-947ddc53be01:15809:1875199750407808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788330224.008387:0:15809:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788330224.008390:0:15809:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788330224.008393:0:15809:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788330224.008394:0:15809:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788330224.008396:0:15809:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788330224.008397:0:15809:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788330224.008398:0:15809:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788330224.008400:0:15809:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788330224.008402:0:15809:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788330224.008413:0:15809:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788330224.008437:0:15809:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788330224.015042:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788330224.015375:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788330224.015669:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788330224.015828:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788330224.016066:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788330224.016424:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788330224.017737:0:15809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788330224.097940:0:15809:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788330224.098029:0:15809:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788330224.098098:0:15809:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788330224.098163:0:15809:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788330224.098317:0:15809:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788330224.098356:0:15809:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1788330224.287914:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750408192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330224.288007:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330224.289787:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408192 00000100:00100000:3.0:1788330224.289803:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408192 00000100:00100000:3.0:1788330224.292480:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788330224.292505:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750408192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330224.292579:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330224.292692:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750408192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (4684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330224.292700:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330224.294864:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750408192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788330224.673800:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788330225.249301:0:14407:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788330225.249310:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff954683588800 from 8 10000000:01000000:3.0:1788330225.249316:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788330225.249374:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.249389:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330225.249403:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330225.249706:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750408320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788330225.249799:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330225.249926:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff954689caf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330225.257611:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408320 00000100:00100000:1.0:1788330225.257629:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408320 00000100:00100000:2.0:1788330225.263801:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330225.263831:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750408320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330225.263856:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330225.263887:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2db000/0x91094de4de9abac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9abab9 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.263925:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2db000/0x91094de4de9abac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9abab9 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.263937:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2db000/0x91094de4de9abac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9abab9 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.263962:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2db000, rc 0) 00000100:00100000:2.0:1788330225.264104:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750408320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 289us (14304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.264112:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788330225.264173:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750408320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330225.264200:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abac0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.264212:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9abac0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330225.264299:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750408448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788330225.264346:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330225.264373:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0163c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330225.264395:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408448 00000100:00100000:2.0:1788330225.264408:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408448 00000100:00100000:2.0:1788330225.265127:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788330225.265138:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750408448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788330225.265157:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788330225.265178:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788330225.265181:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788330225.265273:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750408448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330225.265281:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788330225.265319:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750408448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788330225.265393:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788330225.265404:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abac0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330225.265655:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bf7d9000/0x91094de4de9abab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abac0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330225.696038:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788330226.271157:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788330226.718697:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330227.744856:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330228.773918:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788330229.406717:0:12641:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788330229.406723:0:12641:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788330229.406727:0:12641:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788330229.406740:0:12641:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9546a1ee2000 using connection 192.168.202.147@tcp/0@lo 00000100:00100000:1.0:1788330229.406760:0:12641:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9546b4bfb480 x1875199750408832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788330229.406867:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750408704:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.406949:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330229.407009:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788330229.407015:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750408576:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.407040:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330229.407064:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.407091:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330229.407124:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750408832:0@lo:8:kworker.0 00000100:00100000:1.0:1788330229.407151:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330229.407178:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750408960:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.407200:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330229.407219:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330229.407224:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750409088:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.407243:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330229.407552:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408704 00000100:00100000:1.0:1788330229.407562:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408704 00000100:00100000:1.0:1788330229.407620:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408832 00000100:00100000:1.0:1788330229.407624:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408832 00000100:00100000:1.0:1788330229.407648:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330229.407688:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750408704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.407737:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750408704:12345-0@lo:400:kworker.0 Request processed in 52us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330229.407744:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788330229.407758:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330229.407762:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3311:x1875199750408832:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788330229.407796:0:15092:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1788330229.407826:0:15092:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x91094de4de9abac7 00002000:00100000:1.0:1788330229.407847:0:15092:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff954584b88000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788330229.407851:0:15092:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788330229.407853:0:15092:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788330229.408126:0:15092:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788330229.408149:0:15092:0:(import.c:65:import_set_state_nolock()) ffff954584b8a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788330229.408194:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875199750408832:12345-0@lo:8:kworker.0 Request processed in 430us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330229.408201:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788330229.408227:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408576 00000100:00100000:1.0:1788330229.408232:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408576 00000100:00100000:1.0:1788330229.408259:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330229.408266:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3315:x1875199750408576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.408297:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3315:x1875199750408576:12345-0@lo:400:kworker.0 Request processed in 31us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330229.408303:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788330229.408332:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409216 00000100:00100000:1.0:1788330229.408335:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409216 00000100:00100000:1.0:1788330229.408352:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750408960 00000100:00100000:1.0:1788330229.408354:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750408960 00000100:00100000:1.0:1788330229.408362:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409088 00000100:00100000:1.0:1788330229.408364:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409088 00000100:00100000:1.0:1788330229.408375:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330229.408380:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750409216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.408406:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3315:x1875199750409216:12345-0@lo:400:kworker.0 Request processed in 27us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330229.408412:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788330229.408423:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330229.408429:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750408960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.408471:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875199750408960:12345-0@lo:400:kworker.0 Request processed in 42us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330229.408477:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788330229.408489:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788330229.408494:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750409088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.408544:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750409088:12345-0@lo:400:kworker.0 Request processed in 50us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330229.408550:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788330229.408600:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfb480 x1875199750408832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788330254 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788330229.408616:0:3311:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788330229.408623:0:3311:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788330229.408628:0:3311:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788330229.408630:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9546a1ee2000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788330229.408640:0:3311:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788330229.408645:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3311:1875199750408832:0@lo:8:kworker.0 00010000:00080000:1.0:1788330229.408674:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bf8a80 x1875199750409088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330229.408683:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750409088:0@lo:400:kworker.0 00010000:00080000:1.0:1788330229.408692:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfa680 x1875199750408960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330229.408699:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875199750408960:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.408720:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750408576:0@lo:400:kworker.0 00010000:00080000:1.0:1788330229.408738:0:3315:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9546b4bfa300 x1875199750409216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788330245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788330229.408748:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3315:1875199750409216:0@lo:400:kworker.0 00000100:00100000:1.0:1788330229.408758:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750408704:0@lo:400:kworker.0 00000004:00080000:3.0:1788330229.411130:0:14434:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788330229.411175:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1875199750409472:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788330229.411255:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330229.411294:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff954688428f00 going to sleep for 11 seconds 00000004:00080000:3.0:1788330229.411316:0:14433:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788330229.411905:0:14433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 484324385587ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788330229.411922:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330229.411937:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750409344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330229.411975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330229.412015:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409344 00000100:00100000:3.0:1788330229.412023:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409344 00000100:00100000:3.0:1788330229.412070:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788330229.412080:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750409344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330229.412110:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330229.412155:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750409344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330229.412162:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788330229.412201:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff95469be23480 x1875199750409344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788330245 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788330229.412219:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750409344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330229.412245:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409472 00000100:00100000:3.0:1788330229.412248:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409472 00000100:00100000:3.0:1788330229.412276:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330229.412282:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1875199750409472:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788330229.414677:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788330229.414686:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788330229.414689:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330229.415021:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788330229.415042:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750409600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330229.415103:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330229.422272:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409600 00000100:00100000:3.0:1788330229.422295:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409600 00000100:00100000:3.0:1788330229.422360:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330229.422371:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750409600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330229.422425:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330229.422556:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750409600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 187us (7451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330229.422564:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788330229.422619:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750409600:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1788330229.425206:0:15092:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788330229.425217:0:15092:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1788330229.425222:0:15092:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1788330229.441906:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.441918:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.441936:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.441940:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.441947:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.441964:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.441975:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.441982:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.442427:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788330229.442665:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788330229.442674:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330229.442683:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:2.0:1788330229.442688:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330229.442701:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330229.442725:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330229.442732:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abace lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330229.442761:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330229.442763:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330229.442765:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.443868:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.443886:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443899:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.443903:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.443908:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443920:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443929:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443936:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443958:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.443970:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.443974:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443981:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.443991:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.443999:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444128:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444136:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abad5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444153:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.444155:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.444156:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.444767:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.444774:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444796:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.444800:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.444805:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444815:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444823:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.444838:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.445226:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.445362:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.445370:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.445380:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.445384:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.445392:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.445407:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.445415:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abadc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.445432:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.445434:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.445436:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.445978:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.445993:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.446005:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.446021:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.446027:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.446039:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.446047:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.446053:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.446079:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330229.447914:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330229.447927:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.447941:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8600 already unused, calling callback (ffffffffc172b230) 00002000:00010000:3.0:1788330229.447945:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788330229.447946:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.447957:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.447960:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.447977:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.447983:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.447989:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.447990:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.448011:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abae3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.448030:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.448038:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.448039:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.448587:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.448605:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.448613:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.448634:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330229.449304:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330229.449311:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.449323:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330229.449328:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.449337:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.449353:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.449360:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abaea lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.449376:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.449378:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.449380:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.452810:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.452824:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.452842:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.452847:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.453214:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453236:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453248:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453255:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453294:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.453311:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.453317:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453324:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.453329:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453337:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453354:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453361:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abaf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.453382:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.453384:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.453386:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.456655:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.456672:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.456690:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.456701:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.456707:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.456721:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.456731:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.456739:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.456759:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330229.457654:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.457662:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457675:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.457678:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.457683:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457693:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457701:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457716:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457736:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330229.457754:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330229.457760:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457768:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.457773:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457794:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457812:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457820:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abaf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.457839:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.457842:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330229.457969:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.458100:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.458103:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458111:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458131:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458139:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abaff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458153:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.458155:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.458157:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.458647:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.458654:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458664:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.458667:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.458672:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458681:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458696:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458703:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.458715:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330229.459343:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.459350:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459360:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.459363:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.459367:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459377:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459384:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459392:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459426:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330229.459441:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330229.459446:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459452:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.459455:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459462:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459474:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459718:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459736:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.459739:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459745:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8e00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.459748:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459766:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459776:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459793:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.459806:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.459808:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.459810:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330229.461186:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.464142:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.464159:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464179:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.464184:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.464192:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464206:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464218:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464234:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464264:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.464287:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.464294:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464301:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.464306:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464315:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464334:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464341:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.464361:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.464363:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.464365:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.468191:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.468220:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.468239:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.468244:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.468251:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.468266:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.468275:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.468282:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.468310:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788330229.468925:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330229.468935:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330229.468945:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330229.468949:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330229.468958:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330229.468979:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330229.468987:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330229.469594:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330229.469597:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330229.469600:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.471775:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.471801:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.471818:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.471823:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.471830:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.471844:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.471871:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.471880:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.471903:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330229.474733:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330229.474750:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.474765:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330229.474771:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.474811:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.474836:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.474845:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c81c6a4/0x91094de4de9abb22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.474870:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.474871:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.474873:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.475297:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.475308:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475321:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.475325:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.475333:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475347:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475357:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475365:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475399:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.475411:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.475416:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475423:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.475427:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475435:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475448:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475970:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a6e76b3/0x91094de4de9abb29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.475996:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.475998:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.476000:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.478299:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.478314:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478332:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.478344:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.478351:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478367:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478377:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478385:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478407:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.478422:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.478427:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478434:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.478439:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.478448:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.479591:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.479618:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000335fd4b0/0x91094de4de9abb30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.479643:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.479646:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.479648:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.482991:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.483004:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483034:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.483038:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.483045:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483058:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483069:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483077:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483103:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330229.483598:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.483609:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483619:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.483622:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.483626:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483635:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483642:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483649:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483663:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330229.483678:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330229.483684:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483692:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.483697:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483706:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483730:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483737:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c836c5d5/0x91094de4de9abb37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483755:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.483758:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483764:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8e00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.483767:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483773:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483793:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483800:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ba78f64/0x91094de4de9abb3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.483810:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.483812:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.483819:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.484241:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.484248:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484256:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.484259:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.484263:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484272:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484279:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484285:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484300:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.484309:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.484313:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484320:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.484323:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484343:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484354:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484360:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dacba275/0x91094de4de9abb45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484373:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.484375:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.484377:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.484811:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.484817:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484826:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.484829:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.484834:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484842:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484850:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484863:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484878:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.484886:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.484890:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484896:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.484899:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484907:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484917:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484924:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000aa87b0d/0x91094de4de9abb4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.484937:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.484939:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.484940:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.485314:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.485326:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485335:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.485338:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.485342:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485351:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485358:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485365:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485379:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788330229.485387:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.485391:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485397:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.485400:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485409:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485427:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485433:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000002ebed1/0x91094de4de9abb53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.485445:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.485447:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.485449:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.485552:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.486242:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.486249:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.486260:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.486263:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.486268:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.486279:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.486288:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.486294:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.486335:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330229.486372:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330229.486380:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.486390:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330229.486394:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.486404:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.486419:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.486440:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fda0b93e/0x91094de4de9abb5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.486459:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.486461:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.486463:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788330229.486706:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788330229.487975:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.487988:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488002:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.488014:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.488020:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488032:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488042:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488049:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488070:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330229.488564:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330229.488572:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.488583:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d8600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330229.488588:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.488598:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.488616:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.488624:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000333f28ec/0x91094de4de9abb61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.488649:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.488651:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.488660:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.488706:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.488712:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488721:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.488730:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.488735:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488745:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488752:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488759:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.488791:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330229.489195:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.489201:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489209:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.489212:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.489216:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489226:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489234:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489248:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489266:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330229.489276:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330229.489281:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489287:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bf7d9800 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.489291:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489299:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489310:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489317:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000320417fd/0x91094de4de9abb68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489333:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.489336:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489354:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.489358:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489366:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489376:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489383:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1b6b6ce/0x91094de4de9abb6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.489395:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.489396:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.489398:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.489437:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.490382:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.490391:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.490402:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.490405:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.490411:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.490421:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.490437:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.490445:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.492703:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788330229.493920:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788330229.493930:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.493943:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330229.493948:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.493959:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.493979:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.493987:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf41b5b8/0x91094de4de9abb76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330229.494007:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.494009:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.494011:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788330229.495476:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.495489:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.495506:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.495511:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.495532:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.495647:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.495657:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.495666:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.495706:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788330229.496931:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788330229.496941:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.496954:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=484s v=(0 0) 00010000:00010000:3.0:1788330229.496958:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330229.496963:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.496975:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.496984:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.496991:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497287:0:15092:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788330229.497309:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330229.497316:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497324:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.497336:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497344:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497362:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497370:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000955aa8e1/0x91094de4de9abb7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497389:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330229.497393:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497398:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330229.497401:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497408:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497417:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497424:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afbe3221/0x91094de4de9abb84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330229.497444:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.497446:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330229.497502:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330229.499506:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788330229.500192:0:15092:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788330229.500316:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1875199750409472:12345-0@lo:5:osp-pre-1-0.0 Request processed in 88027us (89053us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330229.500329:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330229.501140:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1875199750409472:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788330229.501159:0:14434:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1788330229.501213:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1875199750409728:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788330229.501261:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330229.501307:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b4840 going to sleep for 11 seconds 00000100:00100000:3.0:1788330229.501628:0:15585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409728 00000100:00100000:3.0:1788330229.501636:0:15585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409728 00000100:00100000:3.0:1788330229.501689:0:15585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788330229.501698:0:15585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:14434:x1875199750409728:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788330229.501739:0:15585:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1788330229.516578:0:15585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:14434:x1875199750409728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14871us (15308us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788330229.516592:0:15585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788330229.516663:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1875199750409728:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788330229.516682:0:14434:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1788330229.791541:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330230.822600:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788330231.397930:0:16164:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg247-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788330231.838832:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330232.867789:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330233.783191:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330233.783365:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729443840 00000100:00100000:2.0:1788330233.783379:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729443840 00000100:00100000:2.0:1788330233.783489:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:2.0:1788330233.783499:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2345:x1875199729443840:12345-192.168.202.47@tcp:250:mount.lustre.0 00010000:00080000:2.0:1788330233.783568:0:14404:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e979e524-ede4-47ab-a6d6-7286fd1739fb@192.168.202.47@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788330233.783610:0:14404:0:(genops.c:1385:class_connect()) connect: client e979e524-ede4-47ab-a6d6-7286fd1739fb, cookie 0x91094de4de9abb8b 00000100:00080000:2.0:1788330233.783777:0:14404:0:(import.c:65:import_set_state_nolock()) ffff9546898c7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330233.784015:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+5:2345:x1875199729443840:12345-192.168.202.47@tcp:250:mount.lustre.0 Request processed in 516us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.784025:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 74 00000100:00100000:0.0:1788330233.788017:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.788179:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729443968 00000100:00100000:3.0:1788330233.788189:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729443968 00000100:00100000:3.0:1788330233.788235:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:3.0:1788330233.788246:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+5:13747:x1875199729443968:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788330233.788262:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330233.788280:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508400/0x91094de4de9abb92 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef15 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330233.788309:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508400/0x91094de4de9abb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef15 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330233.788353:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508400/0x91094de4de9abb92 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef15 expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330233.788372:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508400, rc 0) 00000100:00100000:3.0:1788330233.788434:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+6:13747:x1875199729443968:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 190us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330233.788449:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 75 00000100:00100000:1.0:1788330233.791244:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.792090:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444096 00000100:00100000:3.0:1788330233.792102:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444096 00000100:00100000:3.0:1788330233.792175:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:3.0:1788330233.792187:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469833d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+6:13747:x1875199729444096:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788330233.792701:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469833d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+6:13747:x1875199729444096:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 514us (1468us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330233.792712:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 76 00000100:00100000:0.0:1788330233.799052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330233.799286:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444224 00000100:00100000:2.0:1788330233.799296:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444224 00000100:00100000:2.0:1788330233.799372:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 77 00000100:00100000:2.0:1788330233.799382:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+6:13747:x1875199729444224:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330233.799408:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330233.799425:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2dba00/0x91094de4de9abb99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef1c expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.799464:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2dba00/0x91094de4de9abb99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef1c expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.799476:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2dba00/0x91094de4de9abb99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef1c expref: 7 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.799485:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dba00, rc 0) 00000100:00100000:2.0:1788330233.799588:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+7:13747:x1875199729444224:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 207us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.799596:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 77 00000100:00100000:1.0:1788330233.804626:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330233.805081:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444352 00000100:00100000:0.0:1788330233.805094:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444352 00000100:00100000:0.0:1788330233.805155:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 78 00000100:00100000:0.0:1788330233.805166:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+7:13747:x1875199729444352:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330233.805591:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13747:x1875199729444352:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 425us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.805601:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 78 00000100:00100000:1.0:1788330233.809292:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.809682:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444480 00000100:00100000:3.0:1788330233.809693:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444480 00000100:00100000:0.0:1788330233.809920:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:0.0:1788330233.809930:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13747:x1875199729444480:12345-192.168.202.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788330233.810199:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0dea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13747:x1875199729444480:12345-192.168.202.47@tcp:503:mount.lustre.0 Request processed in 269us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.810207:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 79 00000100:00100000:3.0:1788330233.818344:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330233.818481:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444608 00000100:00100000:2.0:1788330233.818494:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444608 00000100:00100000:2.0:1788330233.818593:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 80 00000100:00100000:2.0:1788330233.818604:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13766:x1875199729444608:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330233.820000:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13766:x1875199729444608:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 1385us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.820014:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 80 00000100:00100000:1.0:1788330233.847268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330233.851874:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444736 00000100:00100000:0.0:1788330233.851894:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444736 00000100:00100000:0.0:1788330233.851974:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:0.0:1788330233.851986:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13766:x1875199729444736:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330233.852254:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13766:x1875199729444736:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 269us (4995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.852263:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 81 00000100:00100000:0.0:1788330233.857176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330233.857260:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444864 00000100:00100000:2.0:1788330233.857270:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444864 00000100:00100000:2.0:1788330233.857327:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 82 00000100:00100000:2.0:1788330233.857780:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+8:13747:x1875199729444864:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330233.858084:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330233.858120:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2dbc00/0x91094de4de9abba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef46 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.858155:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2dbc00/0x91094de4de9abba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef46 expref: 9 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.858167:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2dbc00/0x91094de4de9abba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef46 expref: 9 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.858177:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dbc00, rc 0) 00000100:00100000:2.0:1788330233.858304:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+9:13747:x1875199729444864:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 967us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.858313:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 82 00000100:00100000:3.0:1788330233.865255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330233.865558:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729444992 00000100:00100000:0.0:1788330233.865570:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729444992 00000100:00100000:0.0:1788330233.865666:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 83 00000100:00100000:0.0:1788330233.865678:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+9:13747:x1875199729444992:12345-192.168.202.47@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788330233.865708:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788330233.865755:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788330233.865760:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788330233.865763:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788330233.865766:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788330233.868975:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+9:13747:x1875199729444992:12345-192.168.202.47@tcp:256:mount.lustre.0 Request processed in 3289us (3723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.868991:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 83 00000100:00100000:1.0:1788330233.872733:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330233.873909:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445120 00000100:00100000:2.0:1788330233.873921:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445120 00000100:00100000:2.0:1788330233.874041:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 84 00000100:00100000:2.0:1788330233.874053:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+9:13747:x1875199729445120:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330233.874072:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330233.874090:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef4d expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.874115:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 10 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.874123:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 10 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330233.874131:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da800, rc 0) 00000100:00100000:2.0:1788330233.874187:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0debc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13747:x1875199729445120:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 138us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.874210:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 84 00000100:00100000:3.0:1788330233.876855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330233.876971:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445248 00000100:00100000:0.0:1788330233.876981:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445248 00000100:00100000:0.0:1788330233.877071:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:0.0:1788330233.877081:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13747:x1875199729445248:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788330233.877684:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0de9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13747:x1875199729445248:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 602us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.877692:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 85 00000100:00100000:1.0:1788330233.880011:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330233.880152:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445376 00000100:00100000:0.0:1788330233.880162:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445376 00000100:00100000:0.0:1788330233.880254:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:0.0:1788330233.880266:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13747:x1875199729445376:12345-192.168.202.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788330233.880634:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13747:x1875199729445376:12345-192.168.202.47@tcp:503:mount.lustre.0 Request processed in 369us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330233.880643:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 86 00000100:00100000:1.0:1788330233.884125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.884225:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445504 00000100:00100000:3.0:1788330233.884235:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445504 00000100:00100000:3.0:1788330233.884286:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 87 00000100:00100000:3.0:1788330233.884297:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a0deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13770:x1875199729445504:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330233.884782:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a0deac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13770:x1875199729445504:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 485us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330233.884801:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 87 00000100:00100000:1.0:1788330233.896783:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.896826:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445632 00000100:00100000:3.0:1788330233.896837:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445632 00000100:00100000:3.0:1788330233.896897:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 88 00000100:00100000:3.0:1788330233.896908:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a24f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13770:x1875199729445632:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788330233.897180:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a24f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13770:x1875199729445632:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 273us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330233.897188:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 88 00010000:00010000:2.0:1788330233.897370:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330233.917832:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330233.921512:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445760 00000100:00100000:2.0:1788330233.921574:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445760 00000100:00100000:2.0:1788330233.921631:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:2.0:1788330233.921641:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2345:x1875199729445760:12345-192.168.202.47@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788330233.921670:0:14409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from eed7a854-26b2-4d69-8483-63731ccbe763@192.168.202.47@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:2.0:1788330233.921750:0:14409:0:(genops.c:1385:class_connect()) connect: client eed7a854-26b2-4d69-8483-63731ccbe763, cookie 0x91094de4de9abbae 00000004:00100000:2.0:1788330233.921782:0:14409:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788330233.921795:0:14409:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788330233.986161:0:14409:0:(import.c:65:import_set_state_nolock()) ffff9546898c2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330233.986260:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+6:2345:x1875199729445760:12345-192.168.202.47@tcp:38:mount.lustre.0 Request processed in 64615us (68435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.986273:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:1.0:1788330233.994380:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330233.994427:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.994514:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729445888 00000100:00100000:3.0:1788330233.994564:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729445888 00000100:00100000:3.0:1788330233.994774:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446016 00000100:00100000:3.0:1788330233.994778:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446016 00000100:00100000:3.0:1788330233.994799:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:3.0:1788330233.994809:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+7:0:x1875199729445888:12345-192.168.202.47@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788330233.994863:0:14411:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788330233.994953:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+7:0:x1875199729445888:12345-192.168.202.47@tcp:41:mount.lustre.0 Request processed in 145us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330233.994961:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:2.0:1788330233.994984:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:2.0:1788330233.995001:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+6:13747:x1875199729446016:12345-192.168.202.47@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788330233.995018:0:14410:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1788330233.995033:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788330233.995052:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+6:13747:x1875199729446016:12345-192.168.202.47@tcp:41:mount.lustre.0 Request processed in 58us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330233.995507:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:1.0:1788330233.998465:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330233.998775:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446144 00000100:00100000:3.0:1788330233.998789:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446144 00000100:00100000:3.0:1788330233.999022:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330233.999034:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+6:13747:x1875199729446144:12345-192.168.202.47@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788330234.000278:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+6:13747:x1875199729446144:12345-192.168.202.47@tcp:40:mount.lustre.0 Request processed in 1237us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330234.000293:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330234.018357:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330234.018402:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330234.018435:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330234.018666:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446528 00000100:00100000:1.0:1788330234.018680:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446528 00000100:00100000:1.0:1788330234.018731:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:1.0:1788330234.018755:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+6:13747:x1875199729446528:12345-192.168.202.47@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788330234.019357:0:14412:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 520us 00000100:00100000:2.0:1788330234.032916:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446272 00000100:00100000:2.0:1788330234.032934:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446272 00000100:00100000:2.0:1788330234.032996:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446400 00000100:00100000:2.0:1788330234.032999:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446400 00000100:00100000:2.0:1788330234.033036:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:2.0:1788330234.033063:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875199729446272:12345-192.168.202.47@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788330234.033068:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:3.0:1788330234.033077:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875199729446400:12345-192.168.202.47@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788330234.033098:0:15092:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from eed7a854-26b2-4d69-8483-63731ccbe763@192.168.202.47@tcp t0 exp 0000000000000000 cur 488 last 0 00010000:00080000:3.0:1788330234.033107:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from eed7a854-26b2-4d69-8483-63731ccbe763@192.168.202.47@tcp t0 exp 0000000000000000 cur 488 last 0 00000020:00000080:3.0:1788330234.033140:0:15093:0:(genops.c:1385:class_connect()) connect: client eed7a854-26b2-4d69-8483-63731ccbe763, cookie 0x91094de4de9abbbc 00000020:00000080:2.0:1788330234.033140:0:15092:0:(genops.c:1385:class_connect()) connect: client eed7a854-26b2-4d69-8483-63731ccbe763, cookie 0x91094de4de9abbb5 00002000:00100000:2.0:1788330234.033154:0:15092:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eed7a854-26b2-4d69-8483-63731ccbe763/ffff9546b175a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788330234.033428:0:15092:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788330234.033888:0:15092:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788330234.033923:0:15092:0:(import.c:65:import_set_state_nolock()) ffff9546b175b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330234.034232:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+6:2345:x1875199729446272:12345-192.168.202.47@tcp:8:mount.lustre.0 Request processed in 1168us (15827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330234.034243:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00002000:00100000:3.0:1788330234.042202:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eed7a854-26b2-4d69-8483-63731ccbe763/ffff9546915f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788330234.042234:0:15093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788330234.042443:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788330234.042491:0:15093:0:(import.c:65:import_set_state_nolock()) ffff9546915f4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330234.043076:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+6:2345:x1875199729446400:12345-192.168.202.47@tcp:8:mount.lustre.0 Request processed in 9995us (24636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330234.043147:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000004:00200000:2.0:1788330234.059767:0:14412:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788330234.059896:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+6:13747:x1875199729446528:12345-192.168.202.47@tcp:33:mount.lustre.0 Request processed in 41148us (41547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330234.059911:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:1.0:1788330234.310800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330234.310874:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446656 00000100:00100000:2.0:1788330234.310886:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446656 00000100:00100000:3.0:1788330234.311327:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:3.0:1788330234.311344:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+6:13792:x1875199729446656:12345-192.168.202.47@tcp:101:mkdir.0 00010000:00010000:3.0:1788330234.311375:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330234.311410:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abbc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef77 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330234.311481:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abbca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330234.311493:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abbca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330234.311507:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abbca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330234.311772:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788330234.311784:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000004:00200000:0.0:1788330234.312865:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788330234.312871:0:14411:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330234.312923:0:14411:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abbca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330234.314813:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abbc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef77 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330234.314850:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abbca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef77 expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330234.314860:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:0.0:1788330234.314863:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330234.314867:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508600, rc 0) 00000100:00100000:0.0:1788330234.315254:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+7:13792:x1875199729446656:12345-192.168.202.47@tcp:101:mkdir.0 Request processed in 3914us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330234.315264:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:1.0:1788330234.527320:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330234.527366:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750409856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788330234.527447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528391:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750410368:0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.528461:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528495:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330234.528502:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750410240:0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.528559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528594:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750409984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330234.528620:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528639:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750410496:0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.528662:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528681:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788330234.528687:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d3423e3-6627-4c3c-887c-947ddc53be01:3314:1875199750410112:0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.528741:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528764:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750410624:0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.528791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330234.528826:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409856 00000100:00100000:3.0:1788330234.528835:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409856 00000100:00100000:3.0:1788330234.528890:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750409984 00000100:00100000:3.0:1788330234.528894:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750409984 00000100:00100000:3.0:1788330234.528913:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330234.528924:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750409856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330234.529355:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330234.529402:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750409856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 479us (1955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330234.529411:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330234.529433:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330234.529440:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750409984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330234.529450:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330234.529490:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1875199750409984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330234.529496:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330234.529566:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750409984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330234.529593:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410368 00000100:00100000:3.0:1788330234.529597:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410368 00000100:00100000:3.0:1788330234.529622:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410496 00000100:00100000:3.0:1788330234.529626:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410496 00000100:00100000:3.0:1788330234.529638:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410624 00000100:00100000:3.0:1788330234.529641:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410624 00000100:00100000:3.0:1788330234.529657:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330234.529663:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750410368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330234.529926:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3313:1875199750410368:0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.530173:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1875199750410368:12345-0@lo:400:kworker.0 Request processed in 40us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330234.530181:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330234.530197:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330234.530204:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750410496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.530246:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750410496:12345-0@lo:400:kworker.0 Request processed in 44us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330234.530252:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788330234.530263:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788330234.530269:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750410624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330234.530293:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1875199750410624:12345-0@lo:400:kworker.0 Request processed in 25us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330234.530299:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788330234.530493:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750409856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330234.530635:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3314:1875199750410624:0@lo:400:kworker.0 00000100:00100000:2.0:1788330234.530648:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750410496:0@lo:400:kworker.0 00000100:00100000:0.0:1788330234.531023:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410112 00000100:00100000:0.0:1788330234.531030:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410112 00000100:00100000:0.0:1788330234.531079:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788330234.531087:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a24f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3314:x1875199750410112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330234.531136:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a24f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3314:x1875199750410112:12345-0@lo:400:kworker.0 Request processed in 50us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330234.531142:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788330234.531169:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788330234.531175:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788330234.531177:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330234.531187:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410240 00000100:00100000:0.0:1788330234.531191:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410240 00000100:00100000:0.0:1788330234.531217:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788330234.531224:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750410240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330234.531270:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1875199750410240:12345-0@lo:400:kworker.0 Request processed in 46us (2710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330234.531276:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788330234.531314:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d3423e3-6627-4c3c-887c-947ddc53be01:3314:1875199750410112:0@lo:400:kworker.0 00000100:00100000:0.0:1788330234.535339:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750410240:0@lo:400:kworker.0 00000001:00100000:0.0:1788330234.677602:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788330234.677626:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eed7a854-26b2-4d69-8483-63731ccbe763 00000001:00080000:0.0:1788330234.677635:0:7629:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1788330234.911048:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330235.146171:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eed7a854-26b2-4d69-8483-63731ccbe763 00010000:00010000:2.0:1788330235.934862:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788330236.511348:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330236.676613:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330236.676849:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446784 00000100:00100000:2.0:1788330236.676875:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446784 00000100:00100000:2.0:1788330236.676968:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:2.0:1788330236.676981:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+7:13844:x1875199729446784:12345-192.168.202.47@tcp:41:lfs.0 00000004:00000024:2.0:1788330236.677027:0:14410:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788330236.677111:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+7:13844:x1875199729446784:12345-192.168.202.47@tcp:41:lfs.0 Request processed in 133us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330236.677119:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00080000:1.0:1788330236.677239:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330236.687084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330236.687147:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729446912 00000100:00100000:3.0:1788330236.687160:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729446912 00000100:00100000:3.0:1788330236.687246:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:3.0:1788330236.687258:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eed7a854-26b2-4d69-8483-63731ccbe763+5:13844:x1875199729446912:12345-192.168.202.47@tcp:13:lfs.0 00002000:00000024:3.0:1788330236.687303:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330236.687429:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eed7a854-26b2-4d69-8483-63731ccbe763+5:13844:x1875199729446912:12345-192.168.202.47@tcp:13:lfs.0 Request processed in 173us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330236.687437:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00080000:1.0:1788330236.687598:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788330236.692452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330236.692566:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447040 00000100:00100000:3.0:1788330236.692577:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447040 00000100:00100000:3.0:1788330236.692699:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330236.692710:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eed7a854-26b2-4d69-8483-63731ccbe763+5:13844:x1875199729447040:12345-192.168.202.47@tcp:13:lfs.0 00002000:00000024:3.0:1788330236.692798:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330236.692909:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:eed7a854-26b2-4d69-8483-63731ccbe763+5:13844:x1875199729447040:12345-192.168.202.47@tcp:13:lfs.0 Request processed in 186us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330236.692925:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00080000:1.0:1788330236.701443:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788330236.969445:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330237.000619:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330237.000790:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447168 00000100:00100000:0.0:1788330237.000801:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447168 00000100:00100000:0.0:1788330237.000865:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 90 00000100:00100000:0.0:1788330237.000875:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+10:13876:x1875199729447168:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788330237.000894:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330237.000913:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bfacf800/0x91094de4de9abbd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7ef7e expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.000946:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bfacf800/0x91094de4de9abbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef7e expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.000959:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bfacf800/0x91094de4de9abbd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef7e expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.000969:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf800, rc 0) 00000100:00100000:0.0:1788330237.001049:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13876:x1875199729447168:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 166us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.001057:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 90 00000100:00100000:0.0:1788330237.009938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.010083:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447296 00000100:00100000:2.0:1788330237.010094:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447296 00000100:00100000:2.0:1788330237.010154:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:2.0:1788330237.010165:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13876:x1875199729447296:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788330237.010976:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13876:x1875199729447296:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 808us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.010987:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 91 00000100:00100000:1.0:1788330237.020427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.020618:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447424 00000100:00100000:2.0:1788330237.020632:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447424 00000100:00100000:2.0:1788330237.020695:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 92 00000100:00100000:2.0:1788330237.020704:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13876:x1875199729447424:12345-192.168.202.47@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788330237.021200:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13876:x1875199729447424:12345-192.168.202.47@tcp:503:mount.lustre.0 Request processed in 493us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.021210:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 92 00000100:00100000:3.0:1788330237.031168:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.031363:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447552 00000100:00100000:2.0:1788330237.031376:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447552 00000100:00100000:2.0:1788330237.031614:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 93 00000100:00100000:2.0:1788330237.031627:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13883:x1875199729447552:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330237.032058:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13883:x1875199729447552:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 431us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.032074:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 93 00000100:00100000:1.0:1788330237.059936:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330237.060054:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447680 00000100:00100000:0.0:1788330237.060089:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447680 00000100:00100000:0.0:1788330237.060156:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 94 00000100:00100000:0.0:1788330237.060167:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13883:x1875199729447680:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330237.060509:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13883:x1875199729447680:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 342us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.060563:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 94 00000100:00100000:1.0:1788330237.067626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.067746:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447808 00000100:00100000:2.0:1788330237.067757:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447808 00000100:00100000:2.0:1788330237.067806:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 95 00000100:00100000:2.0:1788330237.067816:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13876:x1875199729447808:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788330237.067834:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330237.067853:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2db600/0x91094de4de9abbd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7efa8 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330237.067884:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2db600/0x91094de4de9abbd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efa8 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330237.067896:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2db600/0x91094de4de9abbd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efa8 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330237.067908:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2db600, rc 0) 00000100:00100000:2.0:1788330237.067987:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13876:x1875199729447808:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 171us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.067993:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 95 00000100:00100000:3.0:1788330237.078766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.078892:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729447936 00000100:00100000:2.0:1788330237.078903:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729447936 00000100:00100000:2.0:1788330237.078969:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 96 00000100:00100000:2.0:1788330237.078980:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13876:x1875199729447936:12345-192.168.202.47@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788330237.079011:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788330237.079055:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788330237.079059:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788330237.079062:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788330237.079166:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788330237.088641:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13876:x1875199729447936:12345-192.168.202.47@tcp:256:mount.lustre.0 Request processed in 9649us (9871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.088657:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 96 00000100:00100000:1.0:1788330237.095741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330237.098487:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448064 00000100:00100000:0.0:1788330237.098504:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448064 00000100:00100000:0.0:1788330237.098594:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 97 00000100:00100000:0.0:1788330237.098606:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13876:x1875199729448064:12345-192.168.202.47@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788330237.098625:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330237.098644:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7efaf expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.098676:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.098688:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.098697:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface800, rc 0) 00000100:00100000:0.0:1788330237.099245:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13876:x1875199729448064:12345-192.168.202.47@tcp:101:mount.lustre.0 Request processed in 637us (3510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.099254:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 97 00000100:00100000:3.0:1788330237.103231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.104262:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448192 00000100:00100000:2.0:1788330237.104275:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448192 00000100:00100000:2.0:1788330237.104495:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 98 00000100:00100000:2.0:1788330237.104508:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13876:x1875199729448192:12345-192.168.202.47@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788330237.104892:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13876:x1875199729448192:12345-192.168.202.47@tcp:501:mount.lustre.0 Request processed in 386us (1671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.104901:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 98 00000100:00100000:1.0:1788330237.106952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330237.107030:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448320 00000100:00100000:0.0:1788330237.107041:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448320 00000100:00100000:0.0:1788330237.107104:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 99 00000100:00100000:0.0:1788330237.107115:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13876:x1875199729448320:12345-192.168.202.47@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788330237.107688:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13876:x1875199729448320:12345-192.168.202.47@tcp:503:mount.lustre.0 Request processed in 573us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.107698:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 99 00000100:00100000:1.0:1788330237.111363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.111697:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448448 00000100:00100000:2.0:1788330237.111708:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448448 00000100:00100000:2.0:1788330237.111781:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 100 00000100:00100000:2.0:1788330237.111792:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954586399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13888:x1875199729448448:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788330237.112101:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954586399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13888:x1875199729448448:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 309us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.112110:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 100 00000100:00100000:2.0:1788330237.116705:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330237.116904:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448576 00000100:00100000:0.0:1788330237.116916:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448576 00000100:00100000:0.0:1788330237.117285:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 101 00000100:00100000:0.0:1788330237.117296:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13888:x1875199729448576:12345-192.168.202.47@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788330237.117638:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13888:x1875199729448576:12345-192.168.202.47@tcp:502:llog_process_th.0 Request processed in 342us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.117646:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 101 00000100:00100000:1.0:1788330237.123169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330237.123214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330237.123303:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330237.123421:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449088 00000100:00100000:3.0:1788330237.123433:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449088 00000100:00100000:3.0:1788330237.123507:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:3.0:1788330237.123550:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+7:2349:x1875199729449088:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330237.123628:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+7:2349:x1875199729449088:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 111us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330237.123654:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:3.0:1788330237.124247:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449216 00000100:00100000:3.0:1788330237.124254:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449216 00000100:00100000:3.0:1788330237.124289:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449344 00000100:00100000:3.0:1788330237.124292:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449344 00000100:00100000:3.0:1788330237.124330:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:3.0:1788330237.124338:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729449216:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330237.124377:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729449216:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 40us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330237.124384:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:3.0:1788330237.124398:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:3.0:1788330237.124404:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729449344:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330237.124441:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729449344:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 37us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330237.124448:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:3.0:1788330237.139169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.139332:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448704 00000100:00100000:2.0:1788330237.139342:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448704 00000100:00100000:2.0:1788330237.139422:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:2.0:1788330237.139433:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1875199729448704:12345-192.168.202.47@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788330237.139468:0:14410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 53125d11-03c0-4823-81ae-5aa109fa0df8@192.168.202.47@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1788330237.139571:0:14410:0:(genops.c:1385:class_connect()) connect: client 53125d11-03c0-4823-81ae-5aa109fa0df8, cookie 0x91094de4de9abbe6 00000004:00100000:2.0:1788330237.139609:0:14410:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788330237.139758:0:14410:0:(import.c:65:import_set_state_nolock()) ffff95469db81800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330237.139843:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2345:x1875199729448704:12345-192.168.202.47@tcp:38:mount.lustre.0 Request processed in 408us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.139852:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:1.0:1788330237.145342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330237.145389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330237.145498:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448832 00000100:00100000:3.0:1788330237.145511:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448832 00000100:00100000:3.0:1788330237.145638:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729448960 00000100:00100000:3.0:1788330237.145643:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729448960 00000100:00100000:3.0:1788330237.145667:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:3.0:1788330237.145678:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+7:0:x1875199729448832:12345-192.168.202.47@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788330237.145753:0:16279:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788330237.145834:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+7:0:x1875199729448832:12345-192.168.202.47@tcp:41:mount.lustre.0 Request processed in 157us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330237.145863:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:3.0:1788330237.145884:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:3.0:1788330237.145891:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13876:x1875199729448960:12345-192.168.202.47@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788330237.145902:0:16279:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788330237.145926:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13876:x1875199729448960:12345-192.168.202.47@tcp:41:mount.lustre.0 Request processed in 35us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330237.145931:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00080000:2.0:1788330237.146688:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330237.156750:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330237.156949:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449472 00000100:00100000:3.0:1788330237.156960:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449472 00000100:00100000:3.0:1788330237.158362:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788330237.158394:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13876:x1875199729449472:12345-192.168.202.47@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788330237.158538:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13876:x1875199729449472:12345-192.168.202.47@tcp:40:mount.lustre.0 Request processed in 163us (1804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330237.158547:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:1.0:1788330237.171478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330237.171568:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.171588:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449856 00000100:00100000:2.0:1788330237.171600:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449856 00000100:00100000:1.0:1788330237.171644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330237.171726:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:2.0:1788330237.171738:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13876:x1875199729449856:12345-192.168.202.47@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788330237.171832:0:14413:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788330237.171941:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13876:x1875199729449856:12345-192.168.202.47@tcp:33:mount.lustre.0 Request processed in 204us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.171949:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:3.0:1788330237.172214:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449600 00000100:00100000:3.0:1788330237.172220:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449600 00000100:00100000:2.0:1788330237.172844:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449728 00000100:00100000:2.0:1788330237.172850:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449728 00000100:00100000:0.0:1788330237.176968:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:0.0:1788330237.176982:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875199729449600:12345-192.168.202.47@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788330237.177039:0:15092:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 53125d11-03c0-4823-81ae-5aa109fa0df8@192.168.202.47@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:0.0:1788330237.177095:0:15092:0:(genops.c:1385:class_connect()) connect: client 53125d11-03c0-4823-81ae-5aa109fa0df8, cookie 0x91094de4de9abbed 00002000:00100000:0.0:1788330237.177110:0:15092:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 53125d11-03c0-4823-81ae-5aa109fa0df8/ffff954682f56800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788330237.177126:0:15092:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788330237.177222:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:2.0:1788330237.177229:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875199729449728:12345-192.168.202.47@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788330237.177245:0:15093:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 53125d11-03c0-4823-81ae-5aa109fa0df8@192.168.202.47@tcp t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1788330237.177264:0:15093:0:(genops.c:1385:class_connect()) connect: client 53125d11-03c0-4823-81ae-5aa109fa0df8, cookie 0x91094de4de9abbf4 00002000:00100000:2.0:1788330237.177270:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 53125d11-03c0-4823-81ae-5aa109fa0df8/ffff95469b57c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788330237.177277:0:15093:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788330237.177460:0:15093:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788330237.177497:0:15093:0:(import.c:65:import_set_state_nolock()) ffff95469b57f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788330237.177610:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2345:x1875199729449728:12345-192.168.202.47@tcp:8:mount.lustre.0 Request processed in 379us (5965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330237.177619:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00002000:00080000:0.0:1788330237.177752:0:15092:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788330237.177769:0:15092:0:(import.c:65:import_set_state_nolock()) ffff954682f55000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788330237.177795:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2345:x1875199729449600:12345-192.168.202.47@tcp:8:mount.lustre.0 Request processed in 814us (6227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.177803:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:1.0:1788330237.412181:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330237.412296:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729449984 00000100:00100000:0.0:1788330237.412327:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729449984 00000100:00100000:0.0:1788330237.412408:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:0.0:1788330237.412441:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+6:13909:x1875199729449984:12345-192.168.202.47@tcp:101:mkdir.0 00010000:00010000:0.0:1788330237.412463:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330237.412485:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9abbfb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7efd9 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.412588:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.412602:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.412622:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330237.412663:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788330237.412668:0:14411:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788330237.412687:0:14411:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.412724:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bface200/0x91094de4de9abbfb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.412743:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330237.412752:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:0.0:1788330237.412755:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788330237.412759:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bfacf600, rc 0) 00000100:00100000:0.0:1788330237.412882:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+7:13909:x1875199729449984:12345-192.168.202.47@tcp:101:mkdir.0 Request processed in 442us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330237.412908:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00010000:00010000:2.0:1788330237.982781:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330239.025230:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330239.205662:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 53125d11-03c0-4823-81ae-5aa109fa0df8 00000001:00100000:3.0:1788330239.205683:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eed7a854-26b2-4d69-8483-63731ccbe763 00000100:00100000:3.0:1788330239.646957:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788330239.647239:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330239.647322:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788330239.647330:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750411008:0@lo:400:kworker.0 00000100:00100000:3.0:1788330239.647360:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330239.647394:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750411520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330239.647436:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330239.647478:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411520 00000100:00100000:3.0:1788330239.647489:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411520 00000100:00100000:0.0:1788330239.647547:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411136 00000100:00100000:0.0:1788330239.647553:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411136 00000100:00100000:0.0:1788330239.647612:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788330239.647620:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750410752:0@lo:400:kworker.0 00000100:00100000:0.0:1788330239.647636:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750411136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330239.647668:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330239.647764:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750410880:0@lo:400:kworker.0 00000100:00100000:0.0:1788330239.652828:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750411136:12345-0@lo:400:kworker.0 Request processed in 5194us (5577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330239.652845:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788330239.652865:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788330239.652881:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750411520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788330239.652924:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330239.652980:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750411520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (5543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330239.652988:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788330239.653010:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788330239.653019:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410752 00000100:00100000:3.0:1788330239.653028:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410752 00000100:00100000:0.0:1788330239.653036:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411008 00000100:00100000:0.0:1788330239.653042:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411008 00000100:00100000:0.0:1788330239.653074:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788330239.653081:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750411008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330239.653732:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788330239.653744:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3312:x1875199750410752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330239.653790:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3312:x1875199750410752:12345-0@lo:400:kworker.0 Request processed in 50us (6122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330239.653797:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788330239.653852:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750411648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330239.653885:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330239.653935:0:3315:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788330239.653957:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750411008:0@lo:400:kworker.0 00000100:00100000:3.0:1788330239.653975:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750411520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330239.653988:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750411136:0@lo:400:kworker.0 00000100:00100000:3.0:1788330239.654021:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411648 00000100:00100000:3.0:1788330239.654025:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411648 00000100:00100000:0.0:1788330239.654671:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750411008:12345-0@lo:400:kworker.0 Request processed in 1586us (7305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330239.654683:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330239.654813:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788330239.654839:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750411648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330239.654871:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330239.654926:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3315:x1875199750411648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330239.654933:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788330239.654957:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788330239.654988:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf810e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3315:1875199750411648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788330239.655159:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330239.655196:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750410880 00000100:00100000:2.0:1788330239.655202:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750410880 00000100:00100000:2.0:1788330239.655232:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330239.655241:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750410880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330239.655278:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750410880:12345-0@lo:400:kworker.0 Request processed in 40us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330239.655284:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788330239.655309:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750410880:0@lo:400:kworker.0 00000100:00100000:2.0:1788330239.655320:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750411392:0@lo:400:kworker.0 00000100:00100000:2.0:1788330239.655350:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330239.655376:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411392 00000100:00100000:2.0:1788330239.655380:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411392 00000100:00100000:2.0:1788330239.655414:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330239.655420:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750411392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330239.655450:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750411392:12345-0@lo:400:kworker.0 Request processed in 30us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330239.655455:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788330239.655482:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750411392:0@lo:400:kworker.0 00000100:00080000:2.0:1788330239.655531:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330239.655971:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750410752:0@lo:400:kworker.0 00000100:00100000:1.0:1788330239.655982:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750411264:0@lo:400:kworker.0 00000100:00100000:1.0:1788330239.656013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330239.656115:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411264 00000100:00100000:1.0:1788330239.656120:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411264 00000100:00100000:1.0:1788330239.656157:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788330239.656164:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750411264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330239.656198:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875199750411264:12345-0@lo:400:kworker.0 Request processed in 35us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330239.656204:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788330239.656232:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3312:1875199750411264:0@lo:400:kworker.0 00000100:00080000:2.0:1788330239.656993:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788330239.775210:0:7629:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 53125d11-03c0-4823-81ae-5aa109fa0df8 00010000:00010000:2.0:1788330240.030833:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788330240.252175:0:6702:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 53125d11-03c0-4823-81ae-5aa109fa0df8 00010000:00010000:1.0:1788330241.055935:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788330241.158177:0:16372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788330242.079237:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330242.393900:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.393942:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.393975:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.394007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.394023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.394045:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.394070:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330242.394103:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450624 00000100:00100000:2.0:1788330242.394114:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450624 00000100:00100000:2.0:1788330242.394172:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450240 00000100:00100000:2.0:1788330242.394176:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450240 00000100:00100000:2.0:1788330242.394198:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:2.0:1788330242.394207:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2346:x1875199729450624:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330242.394277:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2346:x1875199729450624:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 70us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330242.394284:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:2.0:1788330242.394299:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:2.0:1788330242.394305:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+6:2346:x1875199729450240:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330242.394327:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+6:2346:x1875199729450240:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 22us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330242.394334:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:2.0:1788330242.394351:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450368 00000100:00100000:2.0:1788330242.394355:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450368 00000100:00100000:2.0:1788330242.394374:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450880 00000100:00100000:2.0:1788330242.394391:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450880 00000100:00100000:2.0:1788330242.394406:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450496 00000100:00100000:2.0:1788330242.394409:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450496 00000100:00100000:2.0:1788330242.394419:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450752 00000100:00100000:2.0:1788330242.394421:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450752 00000100:00100000:2.0:1788330242.394435:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:2.0:1788330242.394441:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+5:2346:x1875199729450368:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:2.0:1788330242.394471:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+5:2346:x1875199729450368:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 30us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330242.394477:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:2.0:1788330242.394489:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:2.0:1788330242.394495:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2346:x1875199729450880:12345-192.168.202.47@tcp:400:kworker.0 00000100:00080000:1.0:1788330242.394652:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788330242.394656:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330242.394671:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330242.394685:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:1.0:1788330242.394693:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eed7a854-26b2-4d69-8483-63731ccbe763+5:2346:x1875199729450496:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330242.394721:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eed7a854-26b2-4d69-8483-63731ccbe763+5:2346:x1875199729450496:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330242.394726:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:1.0:1788330242.394738:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:1.0:1788330242.394743:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2346:x1875199729450752:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330242.394760:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2346:x1875199729450752:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 18us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330242.394773:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:0.0:1788330242.395788:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729450112 00000100:00100000:0.0:1788330242.395802:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729450112 00000100:00100000:0.0:1788330242.395867:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 103 00000100:00100000:0.0:1788330242.395875:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95458639a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:2346:x1875199729450112:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330242.395936:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95458639a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:2346:x1875199729450112:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 62us (2049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330242.395943:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 103 00000100:00100000:2.0:1788330242.396443:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2346:x1875199729450880:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 23us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330242.396452:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00010000:00010000:0.0:1788330243.110212:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788330244.127314:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330244.766727:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788330244.766769:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750411776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330244.766851:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330244.766923:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411776 00000100:00100000:3.0:1788330244.766934:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411776 00000100:00100000:3.0:1788330244.766998:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330244.767011:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750411776:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330244.767024:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750411904:0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330244.767051:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330244.767057:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330244.767117:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750411776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.767124:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788330244.767140:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750411904 00000100:00100000:3.0:1788330244.767144:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750411904 00000100:00100000:3.0:1788330244.767163:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788330244.767169:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750411904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788330244.767192:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788330244.767229:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1875199750411904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.767237:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788330244.768177:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750411776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788330244.768197:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3313:1875199750411904:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788330244.769107:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330244.769115:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330244.770028:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750412416:0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.770108:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330244.770160:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788330244.770166:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750412032:0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.770197:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330244.770256:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750412416 00000100:00100000:1.0:1788330244.770264:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750412416 00000100:00100000:1.0:1788330244.770319:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788330244.770329:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750412416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788330244.770371:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750412160:0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.770386:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875199750412416:12345-0@lo:400:kworker.0 Request processed in 58us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330244.770395:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788330244.770410:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330244.770422:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750412032 00000100:00100000:1.0:1788330244.770428:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750412032 00000100:00100000:0.0:1788330244.770437:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788330244.770446:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750412288:0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.770478:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788330244.770478:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330244.770491:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3312:x1875199750412032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.772772:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3312:x1875199750412032:12345-0@lo:400:kworker.0 Request processed in 2275us (2564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330244.772790:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788330244.772846:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330244.772865:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750412160 00000100:00100000:1.0:1788330244.772873:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750412160 00000100:00100000:1.0:1788330244.772922:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750412288 00000100:00100000:1.0:1788330244.772927:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750412288 00000100:00100000:1.0:1788330244.772967:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330244.772974:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750412160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.773041:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1875199750412160:12345-0@lo:400:kworker.0 Request processed in 68us (2632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330244.773048:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788330244.773062:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330244.773069:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750412288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.773105:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1875199750412288:12345-0@lo:400:kworker.0 Request processed in 36us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330244.773112:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788330244.773151:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546b4bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0d3423e3-6627-4c3c-887c-947ddc53be01:3312:1875199750412032:0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.773169:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3312:1875199750412416:0@lo:400:kworker.0 00000100:00080000:1.0:1788330244.773216:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788330244.773250:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3314:1875199750412288:0@lo:400:kworker.0 00000100:00100000:1.0:1788330244.773264:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3314:1875199750412160:0@lo:400:kworker.0 00000020:00000080:0.0:1788330244.909049:0:16520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd5fa08c40 20000000:00000080:0.0:1788330244.909070:0:16520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9545850f2800 uarg=0000000000000000 20000000:01000000:0.0:1788330244.909111:0:16520:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788330244.909118:0:16520:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788330244.909123:0:16520:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788330244.920945:0:16521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788330244.921250:0:16520:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788330244.935237:0:16520:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788330244.938047:0:16520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938072:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938080:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9ab946 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938088:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9aba81 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938116:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938124:0:16520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938132:0:16520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938186:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938203:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.938219:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412544:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330244.938365:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938374:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 12 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.938382:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412672:192.168.202.47@tcp:104: 00010000:00010000:1.0:1788330244.938407:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9aba81 expref: 18 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938415:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9aba81 expref: 18 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.938435:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412800:0@lo:104: 00000100:00100000:1.0:1788330244.938470:0:16520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330244.938503:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9ab946 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938511:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9ab946 expref: 18 pid: 14405 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.938544:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412928:0@lo:104: 00000100:00100000:1.0:1788330244.938561:0:16520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788330244.938582:0:16520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330244.938590:0:16520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 18 pid: 14403 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.938598:0:16520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750413056:0@lo:104: 00000100:00100000:1.0:1788330244.938617:0:16520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330244.938625:0:16520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b78780 going to sleep for 11 seconds 00000100:00100000:3.0:1788330244.938887:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788330244.938912:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750412800 00000100:00100000:3.0:1788330244.938919:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750412800 00000100:00100000:3.0:1788330244.938961:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750412928 00000100:00100000:3.0:1788330244.938963:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750412928 00000100:00100000:3.0:1788330244.938972:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413056 00000100:00100000:3.0:1788330244.938974:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413056 00000100:00100000:3.0:1788330244.938986:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330244.938995:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+5:16520:x1875199750412800:12345-0@lo:104: 00010000:00010000:3.0:1788330244.939008:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939069:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788330244.939075:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+5:16520:x1875199750412800:12345-0@lo:104: Request processed in 82us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.939082:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330244.939100:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330244.939107:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+4:16520:x1875199750412928:12345-0@lo:104: 00010000:00010000:3.0:1788330244.939114:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939148:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788330244.939152:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+4:16520:x1875199750412928:12345-0@lo:104: Request processed in 47us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.939157:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330244.939168:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330244.939173:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469b8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+3:16520:x1875199750413056:12345-0@lo:104: 00010000:00010000:3.0:1788330244.939180:0:14394:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939214:0:14394:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788330244.939219:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469b8fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0d3423e3-6627-4c3c-887c-947ddc53be01+3:16520:x1875199750413056:12345-0@lo:104: Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.939224:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788330244.939275:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788330244.939282:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939289:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacee00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788330244.939294:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939302:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330244.939308:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330244.939314:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330244.939355:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939361:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330244.939383:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939389:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bfacee00/0x91094de4de9aba81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9aba88 expref: -99 pid: 15809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939413:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788330244.939416:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939421:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacea00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788330244.939424:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939430:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330244.939436:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330244.939441:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330244.939453:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939458:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330244.939472:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939478:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff9546bfacea00/0x91094de4de9ab946 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab94d expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939486:0:14399:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788330244.939489:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939503:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509c00 already unused, calling callback (ffffffffc1d48c20) 10000000:00010000:3.0:1788330244.939506:0:14399:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939513:0:14399:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788330244.939549:0:14399:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788330244.939554:0:14399:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788330244.939568:0:14399:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939573:0:14399:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788330244.939579:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939585:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.147@tcp lock: ffff95468a509c00/0x91094de4de9ab8f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x91094de4de9ab900 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.939598:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330244.939600:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330244.939601:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788330244.939615:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750413184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330244.939658:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330244.939714:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d3423e3-6627-4c3c-887c-947ddc53be01:3314:1875199750413312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330244.939736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330244.939905:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788330244.939911:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d3423e3-6627-4c3c-887c-947ddc53be01:3314:1875199750413440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330244.939934:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330244.939961:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413184 00000100:00100000:3.0:1788330244.939966:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413184 00010000:00010000:3.0:1788330244.939988:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aba81 expref: 19 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330244.940004:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413312 00000100:00100000:3.0:1788330244.940006:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413312 00010000:00010000:3.0:1788330244.940017:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab946 expref: 20 pid: 14405 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330244.940027:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413440 00000100:00100000:3.0:1788330244.940029:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413440 00010000:00010000:3.0:1788330244.940038:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 21 pid: 14403 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330244.940050:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330244.940057:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+21:3313:x1875199750413184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330244.940066:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330244.940071:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9aba81 expref: 21 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.940079:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9aba81 expref: 21 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.940093:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330244.940122:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+21:3313:x1875199750413184:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.940129:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788330244.940149:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330244.940155:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+20:3314:x1875199750413312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330244.940163:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330244.940167:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab946 expref: 20 pid: 14405 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.940175:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9ab946 expref: 20 pid: 14405 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.940184:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330244.940208:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+20:3314:x1875199750413312:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.940214:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788330244.940226:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330244.940232:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469db45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3314:x1875199750413440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788330244.940239:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330244.940243:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 19 pid: 14403 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.940250:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 19 pid: 14403 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.940259:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330244.940276:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469db45450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3314:x1875199750413440:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330244.940282:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788330244.940342:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0d3423e3-6627-4c3c-887c-947ddc53be01:3313:1875199750413184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330244.940366:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d3423e3-6627-4c3c-887c-947ddc53be01:3314:1875199750413440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788330244.940382:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0d3423e3-6627-4c3c-887c-947ddc53be01:3314:1875199750413312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788330244.940505:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330244.940725:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546a2719200/0x91094de4de9aba88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9aba81 expref: 18 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.940739:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412800:0@lo:104: 00010000:00010000:1.0:1788330244.940882:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468a508200/0x91094de4de9ab94d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9ab946 expref: 17 pid: 14405 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.940891:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412928:0@lo:104: 00010000:00010000:1.0:1788330244.940900:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bfacf000/0x91094de4de9ab900 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x91094de4de9ab8f9 expref: 16 pid: 14403 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330244.940917:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750413056:0@lo:104: 00000100:00100000:1.0:1788330244.948503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330244.948613:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451136 00000100:00100000:2.0:1788330244.948623:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451136 00010000:00010000:2.0:1788330244.948929:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 13 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330244.949009:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:2.0:1788330244.949020:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:2346:x1875199729451136:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788330244.949036:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330244.949042:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 13 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330244.949069:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 13 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330244.949091:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330244.949145:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412544:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330244.949147:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:2346:x1875199729451136:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 130us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330244.949155:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00010000:00010000:3.0:1788330244.949160:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff95468c2da800/0x91094de4de9abba7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef4d expref: 13 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330244.949172:0:16520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16520:1875199750412672:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330244.949203:0:16520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330244.964653:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330244.964904:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451008 00000100:00100000:0.0:1788330244.964916:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451008 00010000:00010000:0.0:1788330244.964958:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330244.965011:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:0.0:1788330244.965021:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:2347:x1875199729451008:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330244.965038:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330244.965058:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965072:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965090:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546bface800/0x91094de4de9abbdf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efaf expref: 12 pid: 14404 timeout: 599 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965106:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965114:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965130:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965136:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965143:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965148:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965154:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2719000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330244.965158:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965165:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965196:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330244.965206:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330244.965286:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:2347:x1875199729451008:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 266us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330244.965293:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00010000:00010000:3.0:1788330244.965624:0:16520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.965643:0:16520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330244.965649:0:16520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9546a2719000/0x91094de4de9abc09 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330245.150694:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788330246.174799:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788330246.432450:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330246.432461:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9546a0de1800 from 10 10000000:01000000:0.0:1788330246.432468:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330246.432539:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.432552:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.432564:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330246.432594:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413568:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.432679:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330246.432728:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330246.432857:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413568 00000100:00100000:2.0:1788330246.432866:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413568 00000100:00100000:2.0:1788330246.432922:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788330246.432932:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+16:14407:x1875199750413568:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330246.432946:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330246.432961:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2db200/0x91094de4de9abc17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9abc10 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.432984:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2db200/0x91094de4de9abc17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9abc10 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.432994:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2db200/0x91094de4de9abc17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9abc10 expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.433003:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2db200, rc 0) 00000100:00100000:2.0:1788330246.433045:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585290850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+17:14407:x1875199750413568:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.433052:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788330246.433427:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413568:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330246.433443:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc17 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.433453:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9abc17 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330246.433551:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.433582:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330246.433609:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788330246.433738:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413696 00000100:00100000:1.0:1788330246.433744:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413696 00000100:00100000:1.0:1788330246.433783:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788330246.433791:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+17:14407:x1875199750413696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788330246.434054:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+17:14407:x1875199750413696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330246.434061:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788330246.435338:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.435391:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.435451:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330246.435491:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546b4b7ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788330246.435615:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413824 00000100:00100000:2.0:1788330246.435630:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413824 00000100:00100000:2.0:1788330246.435689:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788330246.435698:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:14407:x1875199750413824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.435884:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+17:14407:x1875199750413824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.435891:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788330246.436055:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413824:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788330246.437033:0:16573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788330246.437239:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788330246.437260:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330246.437271:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc17 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.437283:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bfacec00/0x91094de4de9abc10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc17 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788330246.437294:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788330246.437297:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff95469832e800 from 10 10000000:01000000:2.0:1788330246.437299:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788330246.437343:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.437351:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.437361:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330246.437380:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.437433:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330246.437479:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a4239c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330246.437607:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750413952 00000100:00100000:0.0:1788330246.437614:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750413952 00000100:00100000:0.0:1788330246.437670:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330246.437680:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+17:14407:x1875199750413952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330246.437693:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788330246.437709:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546bface200/0x91094de4de9abc25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9abc1e expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.437733:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546bface200/0x91094de4de9abc25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9abc1e expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.437744:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546bface200/0x91094de4de9abc25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9abc1e expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.437752:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546bface200, rc 0) 00000100:00100000:0.0:1788330246.437797:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585292050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750413952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.437813:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788330246.437856:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c48a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750413952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788330246.437870:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc25 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.437880:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9abc25 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330246.437930:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.437956:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330246.437975:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546833f39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330246.437988:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750414080 00000100:00100000:0.0:1788330246.437991:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750414080 00000100:00100000:0.0:1788330246.438012:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330246.438018:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750414080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.438288:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750414080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.438295:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788330246.438400:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.438429:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.438468:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330246.438482:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546833f39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330246.438493:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750414208 00000100:00100000:0.0:1788330246.438496:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750414208 00000100:00100000:0.0:1788330246.438543:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330246.438556:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750414208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.438716:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585290050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750414208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.438723:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788330246.438763:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414208:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788330246.439921:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788330246.443202:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788330246.443267:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330246.443280:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc25 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.443293:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff95468c2db400/0x91094de4de9abc1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc25 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788330246.443485:0:14407:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788330246.443489:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff954683588800 from 10 10000000:01000000:0.0:1788330246.443493:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788330246.443568:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.443577:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330246.443587:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330246.443616:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.443704:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330246.443755:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546833f3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788330246.443822:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750414336 00000100:00100000:1.0:1788330246.443831:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750414336 00000100:00100000:1.0:1788330246.443884:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788330246.443894:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+18:14407:x1875199750414336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788330246.443907:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330246.443920:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9546a2719200/0x91094de4de9abc33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x91094de4de9abc2c expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330246.443947:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9546a2719200/0x91094de4de9abc33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x91094de4de9abc2c expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330246.443959:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9546a2719200/0x91094de4de9abc33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x91094de4de9abc2c expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330246.443969:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2719200, rc 0) 00000100:00100000:1.0:1788330246.444025:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585292450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750414336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330246.444050:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788330246.444167:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bf813100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330246.444183:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc33 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.444192:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x91094de4de9abc33 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330246.444265:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.444295:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330246.444485:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750414464 00000100:00100000:2.0:1788330246.444490:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750414464 00000100:00100000:2.0:1788330246.444549:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330246.444556:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750414464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.444845:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750414464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.444853:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788330246.444880:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a4233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330246.444892:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.444924:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.444971:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330246.444992:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750414592 00000100:00100000:2.0:1788330246.444996:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750414592 00000100:00100000:2.0:1788330246.445014:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788330246.445019:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750414592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788330246.445171:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585290450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:14407:x1875199750414592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.445178:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788330246.445206:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a4233c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330246.445232:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954587c4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0d3423e3-6627-4c3c-887c-947ddc53be01:14407:1875199750414592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788330246.446400:0:16575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788330246.446630:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788330246.446654:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788330246.446666:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc33 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.446677:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.147@tcp lock: ffff9546bface400/0x91094de4de9abc2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x91094de4de9abc33 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330246.785748:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330246.786735:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451264 00000100:00100000:2.0:1788330246.786749:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451264 00000100:00100000:2.0:1788330246.786817:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:2.0:1788330246.786827:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+11:13761:x1875199729451264:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788330246.786844:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330246.786862:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468c2da800/0x91094de4de9abc3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7efe0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.786891:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468c2da800/0x91094de4de9abc3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efe0 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.786909:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468c2da800/0x91094de4de9abc3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efe0 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330246.786919:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2da800, rc 0) 00000100:00100000:2.0:1788330246.786984:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13761:x1875199729451264:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 159us (1248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330246.786991:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 114 00000100:00100000:2.0:1788330246.793701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330246.793885:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451392 00000100:00100000:0.0:1788330246.793897:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451392 00000100:00100000:0.0:1788330246.793960:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:0.0:1788330246.793971:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13761:x1875199729451392:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.794348:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585293850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13761:x1875199729451392:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 377us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.794368:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 115 00000100:00100000:3.0:1788330246.796966:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330246.797590:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451520 00000100:00100000:0.0:1788330246.797603:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451520 00000100:00100000:0.0:1788330246.797676:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 116 00000100:00100000:0.0:1788330246.797686:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13761:x1875199729451520:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.797928:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585292850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13761:x1875199729451520:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 241us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.797936:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 116 00000040:00080000:1.0:1788330246.816221:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788330246.816935:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330246.816970:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451648 00000100:00100000:3.0:1788330246.816980:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451648 00000100:00100000:3.0:1788330246.817021:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 117 00000100:00100000:3.0:1788330246.817031:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954585291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+12:13761:x1875199729451648:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788330246.817046:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330246.817067:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff95468a508800/0x91094de4de9abc41 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x6506456475e7efe7 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330246.817093:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff95468a508800/0x91094de4de9abc41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efe7 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330246.817104:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff95468a508800/0x91094de4de9abc41 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efe7 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330246.817115:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508800, rc 0) 00000100:00100000:3.0:1788330246.817165:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954585291c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13761:x1875199729451648:12345-192.168.202.47@tcp:101:ll_cfg_requeue.0 Request processed in 135us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330246.817172:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 117 00000100:00100000:0.0:1788330246.823136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330246.823181:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451776 00000100:00100000:0.0:1788330246.823192:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451776 00000100:00100000:0.0:1788330246.823247:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 118 00000100:00100000:0.0:1788330246.823257:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13761:x1875199729451776:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788330246.825782:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13761:x1875199729451776:12345-192.168.202.47@tcp:501:ll_cfg_requeue.0 Request processed in 2516us (2647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330246.825798:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 118 00000100:00100000:2.0:1788330246.831237:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330246.836004:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729451904 00000100:00100000:3.0:1788330246.836020:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729451904 00000100:00100000:3.0:1788330246.836088:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 119 00000100:00100000:3.0:1788330246.836098:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13761:x1875199729451904:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788330246.836450:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da70c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:13761:x1875199729451904:12345-192.168.202.47@tcp:503:ll_cfg_requeue.0 Request processed in 351us (5223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330246.836459:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 119 00010000:00010000:3.0:1788330247.199052:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330247.491054:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330247.491098:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330247.491135:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330247.491167:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330247.491187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330247.491210:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330247.491238:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452288 00000100:00100000:2.0:1788330247.491248:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452288 00000100:00100000:2.0:1788330247.491301:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452544 00000100:00100000:2.0:1788330247.491305:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452544 00000100:00100000:0.0:1788330247.491394:0:15585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452160 00000100:00100000:0.0:1788330247.491399:0:15585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452160 00000100:00100000:0.0:1788330247.491420:0:15585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452672 00000100:00100000:0.0:1788330247.491423:0:15585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452672 00000100:00100000:0.0:1788330247.491443:0:15585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:0.0:1788330247.491453:0:15585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729452288:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330247.491566:0:15585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729452288:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 113us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330247.491574:0:15585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:0.0:1788330247.491609:0:15585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:0.0:1788330247.491632:0:15585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729452160:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330247.491663:0:15585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed7a854-26b2-4d69-8483-63731ccbe763+5:2349:x1875199729452160:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330247.491669:0:15585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:0.0:1788330247.491683:0:15585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:0.0:1788330247.491690:0:15585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2349:x1875199729452672:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:0.0:1788330247.491714:0:15585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2349:x1875199729452672:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 24us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330247.491733:0:15585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788330247.492393:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:3.0:1788330247.492405:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2349:x1875199729452544:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330247.492456:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2349:x1875199729452544:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 54us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330247.492463:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:1.0:1788330247.492594:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452032 00000100:00100000:1.0:1788330247.492602:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452032 00000100:00100000:1.0:1788330247.492653:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452416 00000100:00100000:1.0:1788330247.492657:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452416 00000100:00100000:1.0:1788330247.492680:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:1.0:1788330247.492687:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+6:2349:x1875199729452032:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330247.492719:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+6:2349:x1875199729452032:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 32us (1677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330247.492736:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:1.0:1788330247.492750:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:1.0:1788330247.492756:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954587c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2349:x1875199729452416:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:1.0:1788330247.492782:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954587c48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2349:x1875199729452416:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 26us (1594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330247.492789:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00080000:1.0:1788330247.492810:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788330247.492815:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330247.492818:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788330248.222958:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788330248.596259:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330248.596410:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729452800 00000100:00100000:1.0:1788330248.596429:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729452800 00000100:00100000:1.0:1788330248.596503:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:1.0:1788330248.596514:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+6:14419:x1875199729452800:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330248.596571:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330248.596596:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718200/0x91094de4de9abc48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7efee expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.596685:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.596700:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.596713:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.596728:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.596735:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.596742:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.598380:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719400/0x91094de4de9abc5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.598401:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719400/0x91094de4de9abc5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.598411:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719400/0x91094de4de9abc5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330248.598449:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788330248.598453:0:14411:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330248.598495:0:14411:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719400/0x91094de4de9abc5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599454:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599468:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599477:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599483:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718000 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330248.599487:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599494:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599511:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:1.0:1788330248.599514:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330248.599536:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599542:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718000/0x91094de4de9abc4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599562:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599568:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599574:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599591:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2719a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330248.599595:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599610:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599619:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9546b8e0a500) 00010000:00010000:1.0:1788330248.599622:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330248.599625:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599631:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719a00/0x91094de4de9abc56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599688:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718200/0x91094de4de9abc48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efee expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599703:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719400/0x91094de4de9abc5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efee expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.599711:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9546b8e0a000) 00010000:00010000:1.0:1788330248.599714:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788330248.599716:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2719400, rc 0) 00000100:00100000:1.0:1788330248.599879:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+7:14419:x1875199729452800:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 3365us (3630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330248.599889:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:2.0:1788330248.617794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330248.617923:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453056 00000100:00100000:3.0:1788330248.617958:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453056 00000100:00100000:3.0:1788330248.618027:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788330248.618039:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+7:14419:x1875199729453056:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330248.618063:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330248.618088:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abc64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7eff5 expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.618174:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.618190:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.618211:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.618279:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.618288:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.618295:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.619763:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9abc79 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.619780:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9abc79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.619791:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9abc79 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330248.619812:0:16279:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788330248.620053:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620061:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620067:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620072:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330248.620077:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620084:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620097:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9546b8e0a000) 00010000:00010000:3.0:1788330248.620100:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330248.620105:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620111:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abc6b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620127:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620133:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620149:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620155:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330248.620157:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620164:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620173:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff954689d7ff00) 00010000:00010000:3.0:1788330248.620175:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330248.620179:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.620185:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abc72 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.621867:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abc64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eff5 expref: 10 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.621890:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508a00/0x91094de4de9abc79 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7eff5 expref: 9 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.621899:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954689d7f000) 00010000:00010000:3.0:1788330248.621902:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330248.621905:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508a00, rc 0) 00000100:00100000:3.0:1788330248.622004:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+9:14419:x1875199729453056:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 3965us (4220us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788330248.622024:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:0.0:1788330248.629869:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.630041:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453184 00000100:00100000:2.0:1788330248.630055:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453184 00000100:00100000:2.0:1788330248.630133:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:2.0:1788330248.630144:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+9:14419:x1875199729453184:12345-192.168.202.47@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788330248.630274:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+9:14419:x1875199729453184:12345-192.168.202.47@tcp:59:lhsmtool_posix.0 Request processed in 131us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.630308:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:0.0:1788330248.659751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.659858:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453312 00000100:00100000:2.0:1788330248.659870:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453312 00000100:00100000:2.0:1788330248.659937:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:2.0:1788330248.659948:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+9:14425:x1875199729453312:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330248.659972:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.660000:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9abc87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7effc expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660071:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660085:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660097:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660112:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660119:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660126:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660569:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660588:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660595:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660611:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468c2daa00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.660616:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660623:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660640:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330248.660642:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.660647:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660653:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2daa00/0x91094de4de9abc8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660668:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660673:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660679:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660683:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.660693:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660698:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660706:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff954692606a00) 00010000:00010000:2.0:1788330248.660708:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.660710:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660715:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660750:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9abc87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7effc expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660759:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330248.660761:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.660764:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468c2dbe00/0x91094de4de9abc87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7effc expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.660773:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468c2dbe00, rc 0) 00000100:00100000:2.0:1788330248.660836:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+9:14425:x1875199729453312:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 889us (1094us total) trans 0 rc 301/301 00000100:00100000:2.0:1788330248.660843:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:3.0:1788330248.669347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.669482:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453440 00000100:00100000:2.0:1788330248.669494:0:14418:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453440 00000100:00100000:2.0:1788330248.669581:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:2.0:1788330248.669590:0:14418:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:eed7a854-26b2-4d69-8483-63731ccbe763+9:14425:x1875199729453440:12345-192.168.202.47@tcp:700:lfs.0 00000100:00100000:2.0:1788330248.669696:0:14418:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:eed7a854-26b2-4d69-8483-63731ccbe763+9:14425:x1875199729453440:12345-192.168.202.47@tcp:700:lfs.0 Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.669703:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:0.0:1788330248.672999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.673120:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453696 00000100:00100000:2.0:1788330248.673135:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453696 00000100:00100000:2.0:1788330248.673497:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 19 00000100:00100000:2.0:1788330248.673512:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+9:14425:x1875199729453696:12345-192.168.202.47@tcp:36:lfs.0 00010000:00010000:2.0:1788330248.673681:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788330248.673708:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abbca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7ef77 expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.673730:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330248.673735:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788330248.673964:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.673979:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 5 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.673988:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.674021:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 5 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.674035:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 5 pid: 14411 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330248.674067:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1875199750414720:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330248.674241:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423600 going to sleep for 11 seconds 00000100:00100000:3.0:1788330248.677644:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.677700:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1875199750414720:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330248.677726:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330248.677777:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453824 00000100:00100000:0.0:1788330248.677785:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453824 00010000:00010000:0.0:1788330248.677823:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 6 pid: 14411 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330248.677864:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:0.0:1788330248.677874:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2346:x1875199729453824:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788330248.677889:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788330248.677897:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 6 pid: 14411 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.677908:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 6 pid: 14411 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.677941:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacf600/0x91094de4de9abc02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7efd9 expref: 6 pid: 14411 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.677953:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:0.0:1788330248.677957:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.677963:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.677968:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330248.677989:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788330248.678035:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2346:x1875199729453824:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 164us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330248.678040:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00010000:00010000:2.0:1788330248.678213:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.678221:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.678244:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.678253:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.678262:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.681168:0:14409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788330248.681188:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.681199:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.681207:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.681220:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.681225:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.681232:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.681252:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330248.681256:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.681261:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.681267:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abc9c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788330248.681288:0:14409:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab31d4d8 reply state 00000000ab79ad83 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330248.681298:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330248.681500:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+10:14425:x1875199729453696:12345-192.168.202.47@tcp:36:lfs.0 Request processed in 7987us (8508us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788330248.681509:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 19 00010000:00010000:3.0:1788330248.684506:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.684652:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.684660:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.684667:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330248.684673:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.684681:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.684700:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff954692606a00) 00010000:00010000:3.0:1788330248.684703:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330248.684708:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.684715:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f800/0x91094de4de9abca3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330248.756848:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.756969:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729453952 00000100:00100000:2.0:1788330248.756982:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729453952 00000100:00100000:2.0:1788330248.757050:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:2.0:1788330248.757061:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+9:14433:x1875199729453952:12345-192.168.202.47@tcp:101:lctl.0 00010000:00010000:2.0:1788330248.757086:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.757110:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abcaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f003 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.757190:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fa00/0x91094de4de9abcb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.757216:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fa00/0x91094de4de9abcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.757228:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fa00/0x91094de4de9abcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.757262:0:14410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330248.757266:0:14410:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330248.757309:0:14410:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fa00/0x91094de4de9abcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.757342:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abcaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f003 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.757361:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fa00/0x91094de4de9abcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f003 expref: 10 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.757370:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330248.757373:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330248.757376:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fa00, rc 0) 00000100:00100000:2.0:1788330248.757449:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+10:14433:x1875199729453952:12345-192.168.202.47@tcp:101:lctl.0 Request processed in 390us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.757456:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 20 00000100:00100000:1.0:1788330248.775657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.775759:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729454080 00000100:00100000:2.0:1788330248.775769:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729454080 00000100:00100000:2.0:1788330248.775846:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:2.0:1788330248.775855:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+5:14434:x1875199729454080:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330248.775875:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.775895:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abcb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f00a expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.775957:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f000/0x91094de4de9abcbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.775970:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f000/0x91094de4de9abcbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.775981:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f000/0x91094de4de9abcbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.776013:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330248.776017:0:14411:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330248.776033:0:14411:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f000/0x91094de4de9abcbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.776054:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abcb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f00a expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.776073:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f000/0x91094de4de9abcbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f00a expref: 6 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.776081:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330248.776084:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330248.776088:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214f000, rc 0) 00000100:00100000:2.0:1788330248.776230:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+6:14434:x1875199729454080:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 376us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.776242:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 21 00000100:00100000:0.0:1788330248.778795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.778882:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729454208 00000100:00100000:2.0:1788330248.778892:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729454208 00000100:00100000:2.0:1788330248.778984:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:2.0:1788330248.778994:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:14434:x1875199729454208:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330248.779015:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.779033:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abcc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f011 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779095:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779109:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779120:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779135:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779143:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779148:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779584:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9abcdb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779620:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9abcdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779628:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9abcdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.779660:0:14410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330248.779664:0:14410:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330248.779681:0:14410:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9abcdb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779693:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779699:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779706:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779711:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.779716:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779723:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779736:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330248.779739:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.779743:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779758:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779772:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779778:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779783:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779788:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.779791:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779797:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779805:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff954692606b00) 00010000:00010000:2.0:1788330248.779807:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.779810:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779815:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779846:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abcc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f011 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779872:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9abcdb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f011 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.779880:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606a00) 00010000:00010000:2.0:1788330248.779882:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330248.779884:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214ea00, rc 0) 00000100:00100000:2.0:1788330248.780000:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+7:14434:x1875199729454208:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1006us (1214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.780007:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 22 00000100:00100000:0.0:1788330248.784023:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330248.784139:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729454464 00000100:00100000:1.0:1788330248.784154:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729454464 00000100:00100000:1.0:1788330248.784611:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:1.0:1788330248.784625:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+7:14434:x1875199729454464:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:1.0:1788330248.784648:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330248.784668:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719000/0x91094de4de9abce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f018 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330248.784771:0:14409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788330248.784911:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719000/0x91094de4de9abce2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f018 expref: 9 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.784927:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:1.0:1788330248.784931:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330248.784937:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719000/0x91094de4de9abce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f018 expref: 9 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.784954:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2719000, rc 0) 00000100:00100000:1.0:1788330248.785082:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+8:14434:x1875199729454464:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 460us (1077us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788330248.785090:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 23 00000100:00100000:1.0:1788330248.789623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330248.789945:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729454720 00000100:00100000:3.0:1788330248.789956:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729454720 00000100:00100000:3.0:1788330248.790047:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:3.0:1788330248.790072:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+8:14434:x1875199729454720:12345-192.168.202.47@tcp:36:lfs.0 00010000:00010000:3.0:1788330248.790129:0:16279:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330248.790158:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ea00/0x91094de4de9abcdb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f011 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.790179:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606a00) 00010000:00010000:3.0:1788330248.790189:0:16279:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330248.790288:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.790462:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.790474:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330248.790904:0:16279:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f90e4b58 reply state 00000000d1a72dc2 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330248.790914:0:16279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788330248.790921:0:16279:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788330248.791056:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:53125d11-03c0-4823-81ae-5aa109fa0df8+9:14434:x1875199729454720:12345-192.168.202.47@tcp:36:lfs.0 Request processed in 984us (1443us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788330248.791064:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 24 00000100:00100000:0.0:1788330248.794122:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330248.794203:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729454976 00000100:00100000:3.0:1788330248.794214:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729454976 00000100:00100000:3.0:1788330248.794271:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:3.0:1788330248.794282:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+9:14434:x1875199729454976:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330248.794712:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+10:14434:x1875199729454976:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 431us (599us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788330248.794732:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00010000:00010000:1.0:1788330248.795849:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.795868:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.795892:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.795898:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330248.795903:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.795911:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.795930:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954689d7ff00) 00010000:00010000:1.0:1788330248.795934:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788330248.795939:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.795946:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abcf0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330248.797042:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.797127:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729455232 00000100:00100000:2.0:1788330248.797136:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729455232 00000100:00100000:2.0:1788330248.797182:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:2.0:1788330248.797249:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+9:14434:x1875199729455232:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330248.797276:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.797576:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abcf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f01f expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797672:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797687:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797699:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797714:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797735:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797742:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.797860:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788330248.797952:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797957:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797961:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797964:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.797968:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797972:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797981:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330248.797982:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.797985:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.797989:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abcfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798006:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798009:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798013:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798016:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214e800 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330248.798017:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798021:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798024:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff954692606b00) 00010000:00010000:2.0:1788330248.798026:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330248.798027:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798030:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd05 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798058:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abcf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f01f expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798064:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330248.798066:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330248.798072:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abcf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f01f expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.798079:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e000, rc 0) 00000100:00100000:2.0:1788330248.798126:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:53125d11-03c0-4823-81ae-5aa109fa0df8+10:14434:x1875199729455232:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 937us (1091us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788330248.798132:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 25 00000100:00100000:0.0:1788330248.800105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.800153:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729455360 00000100:00100000:2.0:1788330248.800163:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729455360 00000100:00100000:2.0:1788330248.800216:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:2.0:1788330248.800226:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+10:14434:x1875199729455360:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330248.800249:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.800271:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd13 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f026 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.800347:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.800360:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.800371:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.800406:0:14410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788330248.800410:0:14410:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330248.800427:0:14410:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.800453:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd13 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.800487:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.800495:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:2.0:1788330248.800498:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788330248.800501:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214fe00, rc 0) 00000100:00100000:2.0:1788330248.800611:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+11:14434:x1875199729455360:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 385us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.800619:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 26 00000100:00100000:0.0:1788330248.803640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.803731:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729455488 00000100:00100000:2.0:1788330248.803744:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729455488 00000100:00100000:2.0:1788330248.803810:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:2.0:1788330248.804068:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+11:14434:x1875199729455488:12345-192.168.202.47@tcp:37:lfs.0 00000100:00100000:2.0:1788330248.815205:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+11:14434:x1875199729455488:12345-192.168.202.47@tcp:37:lfs.0 Request processed in 11372us (11567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.815218:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:0.0:1788330248.819719:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330248.819796:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729455744 00000100:00100000:3.0:1788330248.819807:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729455744 00000100:00100000:3.0:1788330248.819869:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:3.0:1788330248.819881:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4a37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+11:14434:x1875199729455744:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330248.820160:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4a37050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:53125d11-03c0-4823-81ae-5aa109fa0df8+12:14434:x1875199729455744:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 280us (451us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788330248.820168:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00000040:00080000:0.0:1788330248.863565:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788330248.878938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330248.879616:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729455872 00000100:00100000:1.0:1788330248.879630:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729455872 00000100:00100000:1.0:1788330248.879746:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:1.0:1788330248.879758:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+10:14440:x1875199729455872:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:1.0:1788330248.879797:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330248.879821:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719000/0x91094de4de9abd21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f02d expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.879905:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.879920:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.879946:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.879962:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.879969:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.879976:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880060:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718400/0x91094de4de9abd36 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880067:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718400/0x91094de4de9abd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880073:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718400/0x91094de4de9abd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330248.880097:0:14409:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788330248.880100:0:14409:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788330248.880132:0:14409:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718400/0x91094de4de9abd36 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880144:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880151:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880167:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880173:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330248.880177:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880184:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880197:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:1.0:1788330248.880200:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330248.880204:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880210:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abd28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880223:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880229:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880234:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880239:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330248.880242:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880273:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880282:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9546b8e0a500) 00010000:00010000:1.0:1788330248.880284:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788330248.880287:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880293:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718c00/0x91094de4de9abd2f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880323:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2719000/0x91094de4de9abd21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f02d expref: 12 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880336:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718400/0x91094de4de9abd36 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f02d expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.880343:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:1.0:1788330248.880345:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788330248.880348:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2718400, rc 0) 00000100:00100000:1.0:1788330248.880415:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+11:14440:x1875199729455872:12345-192.168.202.47@tcp:101:bash.0 Request processed in 659us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330248.880422:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 27 00000100:00100000:0.0:1788330248.886377:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330248.886912:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729456128 00000100:00100000:3.0:1788330248.886923:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729456128 00000100:00100000:3.0:1788330248.886992:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330248.887004:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+11:14440:x1875199729456128:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:3.0:1788330248.887026:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330248.887047:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd3d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f034 expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.887176:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.887193:0:16279:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.887204:0:16279:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.887242:0:16279:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.887277:0:16279:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 11 pid: 14410 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330248.887293:0:16279:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875199750414848:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330248.887939:0:16279:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546bf1b46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788330248.893579:0:16279:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16279:1875199750414848:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330248.893628:0:16279:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330248.896723:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330248.896861:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729456256 00000100:00100000:1.0:1788330248.896873:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729456256 00010000:00010000:1.0:1788330248.896917:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 12 pid: 14410 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330248.896975:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:1.0:1788330248.896986:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+12:2347:x1875199729456256:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330248.897002:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330248.897010:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 12 pid: 14410 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.897025:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 12 pid: 14410 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.897048:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abd1a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f026 expref: 12 pid: 14410 timeout: 603 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.897068:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:1.0:1788330248.897074:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.897085:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.897092:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330248.897130:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330248.897204:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+11:2347:x1875199729456256:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 207us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330248.897214:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00010000:00010000:3.0:1788330248.897775:0:16279:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.897785:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.897809:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.897818:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.897827:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898573:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898584:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898613:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330248.898628:0:16279:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788330248.898657:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898665:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898672:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898677:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508e00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330248.898682:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898689:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898700:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:3.0:1788330248.898703:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330248.898706:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898712:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abd44 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330248.898723:0:16279:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000070957979 reply state 00000000b9c73f7b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330248.898741:0:16279:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788330248.898776:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd3d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898790:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 13 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.898798:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330248.898800:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1788330248.898802:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509400, rc 0) 00000100:00100000:3.0:1788330248.898852:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+14:14440:x1875199729456128:12345-192.168.202.47@tcp:101:bash.0 Request processed in 11850us (12486us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788330248.898860:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 28 00010000:00010000:3.0:1788330248.907047:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.907069:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.907077:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.907083:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330248.907089:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.907097:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.907140:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff954689d7f600) 00010000:00010000:3.0:1788330248.907144:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330248.907148:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330248.907155:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd4b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330248.912811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330248.912936:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729456384 00000100:00100000:2.0:1788330248.912949:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729456384 00000100:00100000:2.0:1788330248.913025:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:2.0:1788330248.913036:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+13:14440:x1875199729456384:12345-192.168.202.47@tcp:101:bash.0 00010000:00010000:2.0:1788330248.913063:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330248.913089:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd60 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f03b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913162:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913194:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913215:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330248.913262:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788330248.913267:0:14411:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330248.913290:0:14411:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913306:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913333:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd60 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 15 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913353:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330248.913360:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:2.0:1788330248.913363:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330248.913367:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e000, rc 0) 00000100:00100000:2.0:1788330248.913436:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+14:14440:x1875199729456384:12345-192.168.202.47@tcp:101:bash.0 Request processed in 402us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330248.913444:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:0.0:1788330248.917069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330248.917163:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729456640 00000100:00100000:3.0:1788330248.917175:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729456640 00000100:00100000:3.0:1788330248.917251:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:3.0:1788330248.917263:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+14:14440:x1875199729456640:12345-192.168.202.47@tcp:35:bash.0 00000100:00100000:3.0:1788330248.917717:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+15:14440:x1875199729456640:12345-192.168.202.47@tcp:35:bash.0 Request processed in 455us (662us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788330248.917726:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:0.0:1788330249.021400:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330249.021504:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729456896 00000100:00100000:2.0:1788330249.021560:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729456896 00000100:00100000:2.0:1788330249.021647:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:2.0:1788330249.021674:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+15:14450:x1875199729456896:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330249.021702:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330249.021725:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f042 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788330249.022099:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788330249.022239:0:14410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788330249.022583:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd6e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f042 expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.022613:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff954692606c00) 00010000:00010000:2.0:1788330249.022617:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788330249.022622:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f042 expref: 17 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.022639:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e200, rc 0) 00000100:00100000:2.0:1788330249.022713:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+16:14450:x1875199729456896:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 1042us (1324us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788330249.022721:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 30 00000100:00100000:0.0:1788330249.029473:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.029581:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729457152 00000100:00100000:3.0:1788330249.029594:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729457152 00000100:00100000:3.0:1788330249.029671:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:3.0:1788330249.029682:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+16:14450:x1875199729457152:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330249.029957:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+17:14450:x1875199729457152:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 275us (494us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788330249.029966:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:0.0:1788330249.090707:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330249.090821:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729457408 00000100:00100000:2.0:1788330249.090831:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729457408 00000100:00100000:2.0:1788330249.090907:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:2.0:1788330249.090919:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+17:14453:x1875199729457408:12345-192.168.202.47@tcp:101:lfs.0 00010000:00010000:2.0:1788330249.090948:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330249.090973:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd7c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f049 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.091074:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd83 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.091105:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.091120:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd83 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330249.091135:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788330249.091321:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e200/0x91094de4de9abd7c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f049 expref: 20 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.091342:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd83 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f049 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.091350:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:2.0:1788330249.091353:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788330249.091357:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e800, rc 0) 00000100:00100000:2.0:1788330249.091425:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+19:14453:x1875199729457408:12345-192.168.202.47@tcp:101:lfs.0 Request processed in 507us (730us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788330249.091432:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 31 00000100:00100000:0.0:1788330249.098261:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330249.098348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330249.098544:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729457664 00000100:00100000:1.0:1788330249.098554:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729457664 00000100:00100000:1.0:1788330249.098631:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:1.0:1788330249.098643:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:2346:x1875199729457664:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330249.098660:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330249.098685:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e800/0x91094de4de9abd83 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f049 expref: 19 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.098703:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330249.098708:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330249.098772:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eed7a854-26b2-4d69-8483-63731ccbe763+18:2346:x1875199729457664:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 131us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330249.098780:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:3.0:1788330249.101963:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729457536 00000100:00100000:3.0:1788330249.101978:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729457536 00000100:00100000:3.0:1788330249.102096:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:3.0:1788330249.102108:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+18:14453:x1875199729457536:12345-192.168.202.47@tcp:54:lfs.0 00010000:00010000:3.0:1788330249.102204:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102222:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102235:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102262:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102269:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102277:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102283:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.102288:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102307:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102337:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330249.102341:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788330249.102346:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.102352:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd91 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.102454:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+18:14453:x1875199729457536:12345-192.168.202.47@tcp:54:lfs.0 Request processed in 349us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.102462:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 32 00000100:00100000:0.0:1788330249.107152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.107375:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729457920 00000100:00100000:3.0:1788330249.107389:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729457920 00000100:00100000:3.0:1788330249.107457:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330249.107469:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+18:14453:x1875199729457920:12345-192.168.202.47@tcp:35:lfs.0 00000100:00100000:3.0:1788330249.108050:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:14453:x1875199729457920:12345-192.168.202.47@tcp:35:lfs.0 Request processed in 583us (910us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788330249.108059:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00010000:00010000:3.0:1788330249.246651:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788330249.387177:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.387266:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729458176 00000100:00100000:3.0:1788330249.387277:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729458176 00000100:00100000:3.0:1788330249.387337:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:3.0:1788330249.387349:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+19:14484:x1875199729458176:12345-192.168.202.47@tcp:101:cat.0 00010000:00010000:3.0:1788330249.387375:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330249.387401:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd98 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f050 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.387560:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd9f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.387574:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.387586:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd9f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330249.387623:0:14411:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788330249.387828:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abd98 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f050 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.387847:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd9f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f050 expref: 21 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.387855:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330249.387858:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330249.387862:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509c00, rc 0) 00000100:00100000:3.0:1788330249.387929:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+21:14484:x1875199729458176:12345-192.168.202.47@tcp:101:cat.0 Request processed in 582us (764us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788330249.387937:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 33 00000100:00100000:1.0:1788330249.392089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.392224:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729458304 00000100:00100000:3.0:1788330249.392234:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729458304 00000100:00100000:3.0:1788330249.392295:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:3.0:1788330249.392305:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eed7a854-26b2-4d69-8483-63731ccbe763+21:2346:x1875199729458304:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788330249.392319:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330249.392344:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abd9f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f050 expref: 21 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.392362:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330249.392367:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330249.392418:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:eed7a854-26b2-4d69-8483-63731ccbe763+20:2346:x1875199729458304:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 114us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.392426:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:3.0:1788330249.392546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.392643:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729458560 00000100:00100000:3.0:1788330249.392648:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729458560 00000100:00100000:3.0:1788330249.392675:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 8 00000100:00100000:3.0:1788330249.392682:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed7a854-26b2-4d69-8483-63731ccbe763+20:14484:x1875199729458560:12345-192.168.202.47@tcp:35:cat.0 00000100:00100000:3.0:1788330249.393018:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed7a854-26b2-4d69-8483-63731ccbe763+21:14484:x1875199729458560:12345-192.168.202.47@tcp:35:cat.0 Request processed in 335us (470us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788330249.393026:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 8 00000001:00080000:1.0:1788330249.442799:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000001:00080000:1.0:1788330249.442906:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934604 is committed 00000001:00080000:1.0:1788330249.442916:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788330249.442923:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:1.0:1788330249.442934:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1788330249.473890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330249.474213:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729458816 00000100:00100000:2.0:1788330249.474226:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729458816 00000100:00100000:2.0:1788330249.474292:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:2.0:1788330249.474303:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+13:14490:x1875199729458816:12345-192.168.202.47@tcp:101:dd.0 00010000:00010000:2.0:1788330249.474662:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330249.474686:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9abdad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f057 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475089:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475104:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475110:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475115:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475145:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475155:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 14 pid: 14411 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.475165:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1875199750414976:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330249.475291:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.475300:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.475308:0:14410:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1875199750415104:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330249.475332:0:14410:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468846d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788330249.478365:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330249.478405:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.478444:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1875199750414976:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330249.478458:0:14410:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc38700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1875199750415104:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330249.478482:0:14410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330249.478547:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729458944 00000100:00100000:1.0:1788330249.478555:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729458944 00010000:00010000:1.0:1788330249.478602:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 15 pid: 14411 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330249.478641:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729459072 00000100:00100000:1.0:1788330249.478645:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729459072 00010000:00010000:1.0:1788330249.478661:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 16 pid: 16279 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330249.478699:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:1.0:1788330249.478708:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfa8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+16:2349:x1875199729458944:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330249.478723:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330249.478730:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 16 pid: 14411 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478742:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 16 pid: 14411 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478764:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abd67 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f03b expref: 16 pid: 14411 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478782:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330249.478787:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.478793:0:14395:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788330249.478797:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478805:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788330249.478808:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788330249.478865:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfa8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+15:2349:x1875199729458944:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 156us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330249.478873:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:1.0:1788330249.478925:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:1.0:1788330249.478932:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+14:2349:x1875199729459072:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330249.478949:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330249.478955:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478966:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478978:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abd52 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f034 expref: 14 pid: 16279 timeout: 604 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478987:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330249.478991:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.478999:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.479005:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.479035:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330249.479056:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+13:2349:x1875199729459072:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 124us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330249.479063:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00010000:00010000:0.0:1788330249.479077:0:14410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330249.479086:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788330249.479109:0:14410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788330249.479332:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9abdad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f057 expref: 14 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330249.479349:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508600/0x91094de4de9abdb4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f057 expref: 13 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330249.479356:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:0.0:1788330249.479371:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788330249.479374:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508600, rc 0) 00000100:00100000:0.0:1788330249.479414:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+13:14490:x1875199729458816:12345-192.168.202.47@tcp:101:dd.0 Request processed in 5113us (5535us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1788330249.479421:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 34 00000100:00100000:3.0:1788330249.482624:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330249.482715:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729459328 00000100:00100000:2.0:1788330249.482725:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729459328 00000100:00100000:2.0:1788330249.482778:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 35 00000100:00100000:2.0:1788330249.482788:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+13:14490:x1875199729459328:12345-192.168.202.47@tcp:36:dd.0 00010000:00010000:2.0:1788330249.483035:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.483052:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.483064:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330249.483108:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788330249.483136:0:14411:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e01adc19 reply state 0000000061615a59 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330249.483142:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788330249.483221:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+16:14490:x1875199729459328:12345-192.168.202.47@tcp:36:dd.0 Request processed in 435us (608us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788330249.483226:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 35 00000020:00080000:2.0:1788330249.483230:0:14411:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788330249.487479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:2.0:1788330249.487575:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.487589:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.487624:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.487645:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330249.487651:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.487658:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.487676:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:2.0:1788330249.487679:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330249.487683:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.487689:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdc2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.488259:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729459456 00000100:00100000:3.0:1788330249.488271:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729459456 00000100:00100000:3.0:1788330249.488427:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:3.0:1788330249.488439:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+15:14490:x1875199729459456:12345-192.168.202.47@tcp:101:dd.0 00010000:00010000:3.0:1788330249.488464:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330249.488482:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abdc9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f05e expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.488671:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f05e expref: 16 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.488703:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abdc9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f05e expref: 16 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.488784:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330249.488788:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330249.488791:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508e00, rc 0) 00000100:00100000:3.0:1788330249.488902:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+16:14490:x1875199729459456:12345-192.168.202.47@tcp:101:dd.0 Request processed in 464us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.488908:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 36 00000100:00100000:3.0:1788330249.512268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330249.512782:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729459712 00000100:00100000:1.0:1788330249.512796:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729459712 00000100:00100000:1.0:1788330249.512876:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330249.512888:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+16:14490:x1875199729459712:12345-192.168.202.47@tcp:103:dd.0 00010000:00010000:1.0:1788330249.512920:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330249.512948:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abdc9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f05e expref: 16 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.512965:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330249.512968:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330249.513087:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+15:14490:x1875199729459712:12345-192.168.202.47@tcp:103:dd.0 Request processed in 202us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330249.513093:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:1.0:1788330249.518549:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330249.520200:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729459840 00000100:00100000:2.0:1788330249.520218:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729459840 00000100:00100000:2.0:1788330249.520349:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:2.0:1788330249.520361:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+15:14490:x1875199729459840:12345-192.168.202.47@tcp:58:dd.0 00010000:00010000:2.0:1788330249.520487:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.520506:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.520544:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788330249.521799:0:14411:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788330249.521958:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788330249.522303:0:14411:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788330249.522656:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+15:14490:x1875199729459840:12345-192.168.202.47@tcp:58:dd.0 Request processed in 2292us (4113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330249.522667:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 37 00000100:00100000:0.0:1788330249.528093:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.528493:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729459968 00000100:00100000:3.0:1788330249.528504:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729459968 00000100:00100000:3.0:1788330249.528604:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 38 00000100:00100000:3.0:1788330249.528615:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+15:14490:x1875199729459968:12345-192.168.202.47@tcp:101:dd.0 00010000:00010000:3.0:1788330249.528637:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330249.528658:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f065 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.528716:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.528727:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 16 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.528748:0:14410:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.528783:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 16 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.528799:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330249.528802:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788330249.528806:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 16 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.528813:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509c00, rc 0) 00000100:00100000:3.0:1788330249.528867:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+16:14490:x1875199729459968:12345-192.168.202.47@tcp:101:dd.0 Request processed in 255us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.528874:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 38 00000040:00080000:0.0:1788330249.887204:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788330249.887217:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788330249.887256:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788330249.887262:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788330249.887382:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14443:1875199750415232:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788330249.887481:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a3e1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788330249.888254:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750415360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330249.888309:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330249.888348:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788330249.888354:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469bc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750415488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330249.888373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330249.888984:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750415360 00000100:00100000:0.0:1788330249.888993:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750415360 00000100:00100000:0.0:1788330249.889042:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750415488 00000100:00100000:0.0:1788330249.889045:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750415488 00000100:00100000:0.0:1788330249.889064:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330249.889073:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469bc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750415360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788330249.889108:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330249.889164:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469bc3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750415360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330249.889172:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788330249.889192:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788330249.889199:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750415488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788330249.889218:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788330249.889245:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875199750415488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330249.889250:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788330249.889324:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788330249.889329:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788330249.889508:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750415744:0@lo:400:kworker.0 00000100:00100000:1.0:1788330249.889572:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330249.889623:0:3315:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788330249.889629:0:3315:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750415616:0@lo:400:kworker.0 00000100:00100000:1.0:1788330249.889657:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788330249.889694:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750415616 00000100:00100000:1.0:1788330249.889698:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750415616 00000100:00100000:1.0:1788330249.889743:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788330249.889750:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3315:x1875199750415616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788330249.889786:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da73450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0d3423e3-6627-4c3c-887c-947ddc53be01+19:3315:x1875199750415616:12345-0@lo:400:kworker.0 Request processed in 37us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330249.889793:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788330249.889837:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0d3423e3-6627-4c3c-887c-947ddc53be01:3315:1875199750415616:0@lo:400:kworker.0 00000100:00100000:2.0:1788330249.890848:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750415744 00000100:00100000:2.0:1788330249.890858:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750415744 00000100:00100000:2.0:1788330249.890914:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788330249.890924:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750415744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788330249.890997:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3315:x1875199750415744:12345-0@lo:400:kworker.0 Request processed in 75us (1424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330249.891004:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788330249.891124:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750416000:0@lo:400:kworker.0 00000100:00100000:3.0:1788330249.891160:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330249.891187:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788330249.891193:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750415872:0@lo:400:kworker.0 00000100:00100000:3.0:1788330249.891214:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330249.891263:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469bc39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750415488:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788330249.891279:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff954584b2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3312:1875199750415360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788330249.891321:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750416000 00000100:00100000:3.0:1788330249.891324:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750416000 00000100:00100000:3.0:1788330249.891356:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750415872 00000100:00100000:3.0:1788330249.891359:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750415872 00000100:00100000:3.0:1788330249.891374:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330249.891380:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750416000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330249.891415:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1875199750416000:12345-0@lo:400:kworker.0 Request processed in 35us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.891421:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788330249.891434:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788330249.891439:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750415872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788330249.891464:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1875199750415872:12345-0@lo:400:kworker.0 Request processed in 25us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.891468:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788330249.891482:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788330249.891498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3313:1875199750415872:0@lo:400:kworker.0 00000100:00100000:3.0:1788330249.891507:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3313:1875199750416000:0@lo:400:kworker.0 00000100:00100000:1.0:1788330249.892029:0:3315:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3315:1875199750415744:0@lo:400:kworker.0 00000100:00100000:0.0:1788330249.898556:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330249.898687:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14443:1875199750415232:192.168.202.47@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788330249.899091:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729460096 00000100:00100000:3.0:1788330249.899099:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729460096 00000100:00100000:3.0:1788330249.899199:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:3.0:1788330249.899210:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460096:12345-192.168.202.47@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788330249.899306:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460096:12345-192.168.202.47@tcp:900:lhsmtool_posix.0 Request processed in 98us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.899314:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:3.0:1788330249.902688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330249.904717:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729460224 00000100:00100000:1.0:1788330249.904750:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729460224 00000100:00100000:1.0:1788330249.904833:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:1.0:1788330249.904845:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460224:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788330249.904876:0:16279:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788330249.905007:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460224:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 165us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330249.905016:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 39 00000100:00100000:1.0:1788330249.909125:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.909211:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729460352 00000100:00100000:3.0:1788330249.909234:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729460352 00000100:00100000:3.0:1788330249.909298:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:3.0:1788330249.909308:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460352:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788330249.909391:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909409:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909432:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909466:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909475:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909482:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909508:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909539:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909547:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788330249.909597:0:14410:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788330249.909620:0:14410:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788330249.909634:0:14410:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909646:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909652:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909660:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909666:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.909670:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909678:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909692:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954689d7f000) 00010000:00010000:3.0:1788330249.909695:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330249.909700:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909706:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abdde lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909720:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909727:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909744:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909749:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.909752:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909758:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.909766:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff954689d7f600) 00010000:00010000:3.0:1788330249.909769:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330249.910070:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910077:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abde5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910095:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910101:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910106:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910111:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.910115:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910132:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910140:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:3.0:1788330249.910143:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330249.910145:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.910150:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abdec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.910299:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460352:12345-192.168.202.47@tcp:34:lhsmtool_posix.0 Request processed in 991us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.910308:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 40 00000100:00100000:0.0:1788330249.915482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330249.915715:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729460608 00000100:00100000:1.0:1788330249.915726:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729460608 00000100:00100000:1.0:1788330249.915798:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:1.0:1788330249.915810:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+16:14492:x1875199729460608:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788330249.915832:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788330249.915855:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718e00/0x91094de4de9abdf3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f06c expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.915961:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.915976:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.915988:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788330249.916016:0:16279:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788330249.916119:0:16279:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916128:0:16279:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916135:0:16279:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916141:0:16279:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2718a00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:1.0:1788330249.916146:0:16279:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916154:0:16279:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916168:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:1.0:1788330249.916171:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788330249.916175:0:16279:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916181:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718a00/0x91094de4de9abdfa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916238:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718e00/0x91094de4de9abdf3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f06c expref: 18 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916250:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff954689d7f000) 00010000:00010000:1.0:1788330249.916252:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788330249.916263:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546a2718e00/0x91094de4de9abdf3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f06c expref: 18 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330249.916273:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546a2718e00, rc 0) 00000100:00100000:1.0:1788330249.916574:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+17:14492:x1875199729460608:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 763us (1100us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788330249.916582:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 41 00000100:00100000:1.0:1788330249.920638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.920721:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729460736 00000100:00100000:3.0:1788330249.920731:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729460736 00000100:00100000:3.0:1788330249.920808:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:3.0:1788330249.920818:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+17:14492:x1875199729460736:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788330249.920854:0:14410:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788330249.920971:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+17:14492:x1875199729460736:12345-192.168.202.47@tcp:53:lhsmtool_posix.0 Request processed in 154us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330249.920979:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 42 00000100:00100000:0.0:1788330249.945661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.945763:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729460992 00000100:00100000:3.0:1788330249.945776:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729460992 00000100:00100000:3.0:1788330249.945846:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:3.0:1788330249.945858:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+17:14492:x1875199729460992:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330249.945881:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330249.945916:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe08 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f073 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788330249.948018:0:14409:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788330249.948034:0:14409:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788330249.948102:0:14409:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788330249.948967:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.948986:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.948997:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.949064:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe08 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f073 expref: 20 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.949082:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f073 expref: 19 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.949092:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f600) 00010000:00010000:3.0:1788330249.949094:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788330249.949098:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508200, rc 0) 00000100:00100000:3.0:1788330249.949181:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:14492:x1875199729460992:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 3325us (3532us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788330249.949198:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 43 00000100:00100000:1.0:1788330249.953455:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.953571:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729461248 00000100:00100000:3.0:1788330249.953584:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729461248 00000100:00100000:3.0:1788330249.953649:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:3.0:1788330249.953676:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+19:14492:x1875199729461248:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330249.953759:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330249.953788:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f073 expref: 19 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.953807:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f600) 00010000:00010000:3.0:1788330249.953818:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330249.953844:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.953861:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.953870:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.953886:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.953893:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.953900:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954119:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954127:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954143:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954150:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.954154:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954162:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954171:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff954692606600) 00010000:00010000:3.0:1788330249.954174:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330249.954178:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954184:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508c00/0x91094de4de9abe1d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954194:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954201:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954207:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954212:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.954229:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954247:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954256:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xf7ccb5b8 (ffff954689d7ff00) 00010000:00010000:3.0:1788330249.954258:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788330249.954261:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.954267:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe24 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xf7ccb5b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.954374:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+18:14492:x1875199729461248:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 699us (933us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788330249.954382:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 44 00000100:00100000:1.0:1788330249.957110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.957358:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729461376 00000100:00100000:3.0:1788330249.957370:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729461376 00000100:00100000:3.0:1788330249.957436:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:3.0:1788330249.957447:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+18:14492:x1875199729461376:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330249.957468:0:16279:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330249.957491:0:16279:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe2b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f07a expref: -99 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.958391:0:16279:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abe32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.958408:0:16279:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abe32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.958420:0:16279:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abe32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16279 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.958834:0:16279:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe2b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f07a expref: 20 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.958858:0:16279:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508e00/0x91094de4de9abe32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f07a expref: 19 pid: 16279 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.958868:0:16279:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:3.0:1788330249.958872:0:16279:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788330249.958875:0:16279:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a508e00, rc 0) 00000100:00100000:2.0:1788330249.959082:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+19:14492:x1875199729461376:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 1633us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330249.959092:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 45 00000100:00100000:1.0:1788330249.965699:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.965851:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729461632 00000100:00100000:3.0:1788330249.965863:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729461632 00000100:00100000:3.0:1788330249.965975:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:3.0:1788330249.965987:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+19:14492:x1875199729461632:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330249.966070:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.966087:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.966098:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788330249.966570:0:14410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788330249.966582:0:14410:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 504879063603ns, next at 505879060686ns, rc = 0 00000004:00010000:3.0:1788330249.966685:0:14410:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000361f102a reply state 00000000fdada87a transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330249.966696:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330249.967355:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+21:14492:x1875199729461632:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 1365us (1663us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788330249.967364:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 46 00000100:00100000:1.0:1788330249.974842:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330249.974925:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729461760 00000100:00100000:2.0:1788330249.974938:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729461760 00000100:00100000:2.0:1788330249.975007:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 47 00000100:00100000:2.0:1788330249.975019:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+21:14492:x1875199729461760:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330249.975047:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330249.975071:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f081 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.975142:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.975159:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330249.975202:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330249.975206:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788330249.975210:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e000, rc 0) 00000100:00100000:2.0:1788330249.975280:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+22:14492:x1875199729461760:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 263us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330249.975294:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 47 00010000:00010000:3.0:1788330249.980599:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.980621:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.980629:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.980635:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509600 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:3.0:1788330249.980640:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.980648:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.980666:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:3.0:1788330249.980669:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788330249.980674:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330249.980679:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509600/0x91094de4de9abe39 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330249.981316:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330249.981482:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729461888 00000100:00100000:0.0:1788330249.981511:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729461888 00000100:00100000:0.0:1788330249.981630:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00100000:0.0:1788330249.981641:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2347:x1875199729461888:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788330249.982042:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+6:2347:x1875199729461888:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 402us (733us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788330249.982051:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 12 00000100:00080000:3.0:1788330249.982347:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788330249.994688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330249.994782:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729462144 00000100:00100000:3.0:1788330249.994793:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729462144 00000100:00100000:3.0:1788330249.994862:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:3.0:1788330249.994874:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed7a854-26b2-4d69-8483-63731ccbe763+21:14492:x1875199729462144:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788330249.995428:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eed7a854-26b2-4d69-8483-63731ccbe763+22:14492:x1875199729462144:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 554us (750us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788330249.995438:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 9 00000100:00100000:2.0:1788330250.013477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330250.016480:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729462400 00000100:00100000:0.0:1788330250.016496:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729462400 00000100:00100000:0.0:1788330250.016757:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:0.0:1788330250.016770:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+22:14492:x1875199729462400:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788330250.016922:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eed7a854-26b2-4d69-8483-63731ccbe763+22:14492:x1875199729462400:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 154us (3455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330250.016930:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 48 00000100:00100000:0.0:1788330250.028203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330250.028320:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729462528 00000100:00100000:2.0:1788330250.028330:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729462528 00000100:00100000:2.0:1788330250.028394:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:2.0:1788330250.028406:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+22:14492:x1875199729462528:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788330250.028430:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788330250.028454:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9abe47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f088 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.028598:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abe4e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.028613:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abe4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.028626:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abe4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788330250.028662:0:14409:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788330250.028683:0:14409:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abe4e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.028724:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214ec00/0x91094de4de9abe47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f088 expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.028932:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abe4e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f088 expref: 23 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.028942:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330250.028945:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788330250.028950:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9546c214e600, rc 0) 00000100:00100000:2.0:1788330250.029055:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+23:14492:x1875199729462528:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 650us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330250.029062:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 49 00000100:00100000:1.0:1788330250.037960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.038138:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729462656 00000100:00100000:3.0:1788330250.038150:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729462656 00000100:00100000:3.0:1788330250.038223:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:3.0:1788330250.038245:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+6:2346:x1875199729462656:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788330250.038264:0:15092:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788330250.038470:0:15092:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x6506456475e7f08f expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788330250.038501:0:15092:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a97c10a, blocks: 0x1 00010000:00010000:3.0:1788330250.038564:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=504s v=(0 0) 00010000:00010000:3.0:1788330250.038570:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.038581:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 7 pid: 15092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.038619:0:15092:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 7 pid: 15092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.038634:0:15092:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95468a509600, rc 0) 00000100:00100000:3.0:1788330250.038690:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+7:2346:x1875199729462656:12345-192.168.202.47@tcp:101:lhsmtool_posix.0 Request processed in 447us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330250.038697:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:1.0:1788330250.043515:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.043755:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729462912 00000100:00100000:3.0:1788330250.043781:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729462912 00000100:00100000:3.0:1788330250.043849:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:3.0:1788330250.043861:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+23:14492:x1875199729462912:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788330250.043995:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+23:14492:x1875199729462912:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 137us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330250.044004:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 50 00000100:00100000:0.0:1788330250.051679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330250.051783:0:16279:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729463040 00000100:00100000:1.0:1788330250.051795:0:16279:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729463040 00000100:00100000:1.0:1788330250.051857:0:16279:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:1.0:1788330250.051868:0:16279:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+23:14492:x1875199729463040:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788330250.164118:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:3.0:1788330250.164154:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:3.0:1788330250.164189:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1788330250.164198:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:1.0:1788330250.164912:0:16279:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eed7a854-26b2-4d69-8483-63731ccbe763+14:14492:x1875199729463040:12345-192.168.202.47@tcp:44:lhsmtool_posix.0 Request processed in 113036us (113235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330250.164926:0:16279:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 51 00000100:00100000:0.0:1788330250.167449:0:3314:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750416128:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788330250.167568:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788330250.168873:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750416128 00000100:00100000:2.0:1788330250.168888:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750416128 00000100:00100000:2.0:1788330250.168961:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788330250.168972:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1875199750416128:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788330250.169193:0:15093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788330250.169197:0:15093:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788330250.169200:0:15093:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788330250.169201:0:15093:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788330250 -> 1788330250 00002000:00010000:2.0:1788330250.169203:0:15093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788330250.169361:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1875199750416128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 316us (1717us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788330250.169368:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1788330250.170917:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9546bfd3e300/2, rc 0, transno 8589934595 00000100:00100000:0.0:1788330250.170931:0:3314:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3314:1875199750416128:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788330250.173858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330250.178468:0:15585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729463168 00000100:00100000:0.0:1788330250.178489:0:15585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729463168 00000100:00100000:0.0:1788330250.178584:0:15585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:0.0:1788330250.178607:0:15585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff954584b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed7a854-26b2-4d69-8483-63731ccbe763+7:2347:x1875199729463168:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788330250.178883:0:15585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff954584b2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:eed7a854-26b2-4d69-8483-63731ccbe763+7:2347:x1875199729463168:12345-192.168.202.47@tcp:16:lhsmtool_posix.0 Request processed in 277us (5033us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330250.178907:0:15585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:2.0:1788330250.183505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.183649:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729463424 00000100:00100000:3.0:1788330250.183659:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729463424 00000100:00100000:3.0:1788330250.183813:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:3.0:1788330250.183824:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+14:14492:x1875199729463424:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788330250.183875:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788330250.183903:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e600/0x91094de4de9abe4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f088 expref: 14 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.183923:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:3.0:1788330250.183928:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788330250.183955:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.183969:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.183978:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788330250.184171:0:14410:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000d590bf4 reply state 00000000efe31b56 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.184181:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788330250.184277:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+15:14492:x1875199729463424:12345-192.168.202.47@tcp:36:lhsmtool_posix.0 Request processed in 455us (782us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788330250.184285:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 52 00000100:00100000:0.0:1788330250.189932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:2.0:1788330250.190074:0:3299:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.190101:0:3299:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.190109:0:3299:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.190115:0:3299:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330250.190121:0:3299:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.190130:0:3299:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.190150:0:3299:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:2.0:1788330250.190153:0:3299:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330250.190158:0:3299:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.190164:0:3299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509200/0x91094de4de9abe5c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.192020:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729463552 00000100:00100000:3.0:1788330250.192036:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729463552 00000100:00100000:3.0:1788330250.192109:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788330250.192120:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+7:2347:x1875199729463552:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788330250.192340:0:15093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788330250.192344:0:15093:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788330249 00002000:00010000:3.0:1788330250.192347:0:15093:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788330249 00002000:00010000:3.0:1788330250.192349:0:15093:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788330250 -> 1788330249 00002000:00010000:3.0:1788330250.192352:0:15093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788330250.192432:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+8:2347:x1875199729463552:12345-192.168.202.47@tcp:2:lhsmtool_posix.0 Request processed in 313us (2510us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788330250.192440:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:1.0:1788330250.194827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.194981:0:15092:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729463680 00000100:00100000:3.0:1788330250.194990:0:15092:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729463680 00000100:00100000:3.0:1788330250.195052:0:15092:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:3.0:1788330250.195063:0:15092:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+8:2346:x1875199729463680:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788330250.195107:0:15092:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195140:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788330250.195145:0:15092:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.195152:0:15092:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195170:0:15092:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195201:0:15092:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195209:0:15092:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195217:0:15092:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195223:0:15092:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330250.195228:0:15092:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195237:0:15092:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195254:0:15092:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.195267:0:15092:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe63 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15092 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.195344:0:15092:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bf811880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eed7a854-26b2-4d69-8483-63731ccbe763+8:2346:x1875199729463680:12345-192.168.202.47@tcp:1:lhsmtool_posix.0 Request processed in 282us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330250.195352:0:15092:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:2.0:1788330250.198917:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.199038:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729463936 00000100:00100000:3.0:1788330250.199049:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729463936 00000100:00100000:3.0:1788330250.199111:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 53 00000100:00100000:3.0:1788330250.199123:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+14:14492:x1875199729463936:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788330250.199216:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199237:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199251:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199573:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199596:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 15 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199606:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199659:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 15 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.199673:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 15 pid: 14409 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.199690:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1875199750416256:192.168.202.47@tcp:104: 00000100:00100000:3.0:1788330250.199792:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0163840 going to sleep for 11 seconds 00000100:00100000:0.0:1788330250.204999:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.205158:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1875199750416256:192.168.202.47@tcp:104: 00010000:00010000:3.0:1788330250.205189:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330250.205265:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464064 00000100:00100000:1.0:1788330250.205273:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464064 00010000:00010000:1.0:1788330250.205310:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 16 pid: 14409 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330250.205366:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 13 00000100:00100000:1.0:1788330250.205376:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eed7a854-26b2-4d69-8483-63731ccbe763+16:2347:x1875199729464064:12345-192.168.202.47@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788330250.205393:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330250.205401:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 16 pid: 14409 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.205414:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 16 pid: 14409 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.205436:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214e000/0x91094de4de9abe40 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f081 expref: 16 pid: 14409 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.205453:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:1.0:1788330250.205458:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.205469:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.205478:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.205508:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330250.205610:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eed7a854-26b2-4d69-8483-63731ccbe763+15:2347:x1875199729464064:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 235us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330250.205618:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 13 00010000:00010000:3.0:1788330250.205995:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.206004:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788330250.206208:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788330250.206358:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788330250.206403:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788330250.206486:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14409:1875199750416384:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788330250.206636:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788330250.206665:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0163a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330250.207076:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750416384 00000100:00100000:2.0:1788330250.207084:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750416384 00000100:00100000:2.0:1788330250.207125:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788330250.207134:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1875199750416384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788330250.207240:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1875199750416384:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788330250.207247:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788330250.207383:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14409:1875199750416384:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788330250.211268:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788330250.211388:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14409:1875199750416512:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788330250.211475:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788330250.211675:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a4239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788330250.211906:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199750416512 00000100:00100000:2.0:1788330250.211913:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199750416512 00000100:00100000:2.0:1788330250.212001:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788330250.212013:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1875199750416512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788330250.212272:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14409:x1875199750416512:12345-0@lo:1000:mdt00_000.0 Request processed in 261us (796us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788330250.212281:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788330250.212370:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546bfd9df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14409:1875199750416512:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788330250.212412:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212424:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212433:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212439:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330250.212444:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212453:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212469:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:0.0:1788330250.212472:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330250.212477:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212495:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509400/0x91094de4de9abe71 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212699:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212707:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212713:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212718:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214f400 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:0.0:1788330250.212729:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212741:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212751:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:0.0:1788330250.212754:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788330250.212761:0:14409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212773:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212782:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.212858:0:14409:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff95468a509c00/0x91094de4de9abdd7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f065 expref: 18 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.212871:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9546a12f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1875199750416640:192.168.202.47@tcp:105: 00000100:00100000:0.0:1788330250.212947:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff95468a423a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788330250.216092:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9546a12f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1875199750416640:192.168.202.47@tcp:105: 00010000:00010000:2.0:1788330250.216124:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216136:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214f400/0x91094de4de9abdd0 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216171:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216185:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216196:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216207:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216213:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216220:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216244:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330250.216248:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216255:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216266:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:2.0:1788330250.216269:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788330250.216273:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216278:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546c214fe00/0x91094de4de9abe78 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216287:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216293:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216299:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216303:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc216b4f0) 00010000:00010000:2.0:1788330250.216306:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216312:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216331:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff954689d7fd00) 00010000:00010000:2.0:1788330250.216334:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788330250.216336:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.216342:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95468a508200/0x91094de4de9abe6a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.217462:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330250.217895:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464192 00000100:00100000:0.0:1788330250.217905:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464192 00000100:00100000:0.0:1788330250.217967:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:0.0:1788330250.217978:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546b4a37450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:14490:x1875199729464192:12345-192.168.202.47@tcp:49:dd.0 00000100:00100000:0.0:1788330250.218120:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546b4a37450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:14490:x1875199729464192:12345-192.168.202.47@tcp:49:dd.0 Request processed in 143us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330250.218127:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 10 00000100:00100000:2.0:1788330250.218265:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469be22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eed7a854-26b2-4d69-8483-63731ccbe763+18:14492:x1875199729463936:12345-192.168.202.47@tcp:57:lhsmtool_posix.0 Request processed in 19144us (19361us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788330250.218273:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 53 00000020:00080000:2.0:1788330250.218277:0:14409:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788330250.221104:0:14443:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788330250.221125:0:14443:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788330250.221165:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788330250.221171:0:14443:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788330250.221460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.221511:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464448 00000100:00100000:3.0:1788330250.221553:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464448 00000100:00100000:0.0:1788330250.221635:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 11 00000100:00100000:0.0:1788330250.221648:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+18:14492:x1875199729464448:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788330250.229576:0:14412:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788330250.229703:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1788330250.229766:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.229784:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.229796:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.229816:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.229823:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.229829:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.229847:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788330250.229970:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eed7a854-26b2-4d69-8483-63731ccbe763+20:14492:x1875199729464448:12345-192.168.202.47@tcp:35:lhsmtool_posix.0 Request processed in 8321us (8512us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788330250.229981:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 11 00000020:00080000:0.0:1788330250.229986:0:14412:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788330250.230904:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788330250.230912:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.230920:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bfacea00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330250.230925:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.230933:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.230948:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff954689d7f800) 00010000:00010000:1.0:1788330250.230951:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788330250.230955:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.230960:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9546bfacea00/0x91094de4de9abe7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.230973:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330250.230975:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788330250.230977:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788330250.271448:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330250.361034:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:2.0:1788330250.361125:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464576 00000100:00100000:2.0:1788330250.361135:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464576 00000100:00100000:2.0:1788330250.361204:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:2.0:1788330250.361215:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eed7a854-26b2-4d69-8483-63731ccbe763+8:2349:x1875199729464576:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:2.0:1788330250.361250:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.361269:0:15097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 8 pid: 15092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.361278:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330250.361282:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788330250.361287:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.361342:0:15097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 8 pid: 15092 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.361357:0:15097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 8 pid: 15092 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788330250.361372:0:15097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15097:1875199750416768:192.168.202.47@tcp:104: 00000100:00100000:2.0:1788330250.361467:0:15097:0:(client.c:2715:ptlrpc_set_wait()) set ffff9546a0ead600 going to sleep for 11 seconds 00000100:00100000:3.0:1788330250.362575:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:1.0:1788330250.362695:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788330250.362703:0:15099:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788330250.364183:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.364479:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788330250.364495:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464704 00000100:00100000:3.0:1788330250.364505:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464704 00000100:00100000:3.0:1788330250.364569:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1788330250.364573:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464832 00000100:00100000:3.0:1788330250.364575:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464832 00000100:00100000:3.0:1788330250.371603:0:16637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:3.0:1788330250.371628:0:16637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eed7a854-26b2-4d69-8483-63731ccbe763+10:2348:x1875199729464704:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:3.0:1788330250.371670:0:16637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.371689:0:16637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.371694:0:16637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.371699:0:16637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.371709:0:16637:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.372377:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330250.372408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330250.372451:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.372579:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788330250.372601:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788330250.372665:0:15097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff95469be20380 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15097:1875199750416768:192.168.202.47@tcp:104: 00010000:00010000:2.0:1788330250.372694:0:15097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330250.372764:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465216 00000100:00100000:1.0:1788330250.372772:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465216 00010000:00010000:1.0:1788330250.372802:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 11 pid: 15092 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.372816:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788330250.372828:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729464960 00000100:00100000:0.0:1788330250.372833:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729464960 00000100:00100000:1.0:1788330250.372865:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 14 00000100:00100000:0.0:1788330250.372867:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:0.0:1788330250.372877:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465088 00000100:00100000:1.0:1788330250.372878:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+12:2347:x1875199729465216:12345-192.168.202.47@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788330250.372882:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465088 00010000:00010000:1.0:1788330250.372895:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788330250.372921:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 13 pid: 15092 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.372940:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 13 pid: 15092 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.372963:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf41b5b8/0x91094de4de9abe55 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.47@tcp remote: 0x6506456475e7f08f expref: 13 pid: 15092 timeout: 605 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.372978:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330250.372982:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330250.372988:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.372996:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.373004:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330250.373007:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330250.373011:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.373027:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.373194:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788330250.373252:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eed7a854-26b2-4d69-8483-63731ccbe763+12:2347:x1875199729465216:12345-192.168.202.47@tcp:103:ldlm_bl.0 Request processed in 378us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788330250.373259:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 14 00010000:00010000:1.0:1788330250.373283:0:15097:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.373292:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.374922:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.375028:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788330250.375041:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465344 00000100:00100000:3.0:1788330250.375059:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465344 00000100:00100000:0.0:1788330250.375605:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:0.0:1788330250.375620:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eed7a854-26b2-4d69-8483-63731ccbe763+13:2348:x1875199729464832:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:0.0:1788330250.375654:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.375677:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330250.375681:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330250.375689:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.375704:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.376326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:3.0:1788330250.376364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00010000:00010000:2.0:1788330250.376439:0:16637:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788330250.376451:0:16637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.377340:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788330250.377349:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1788330250.377546:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465472 00000100:00100000:3.0:1788330250.377553:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465472 00000100:00100000:3.0:1788330250.377610:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1788330250.377616:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465600 00000100:00100000:3.0:1788330250.377618:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465600 00000100:00100000:3.0:1788330250.384055:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:3.0:1788330250.384070:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eed7a854-26b2-4d69-8483-63731ccbe763+17:2348:x1875199729464960:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:3.0:1788330250.384107:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.384125:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.384129:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.384137:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.384152:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788330250.442604:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00080000:0.0:1788330250.442627:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788330250.442637:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00002000:00010000:1.0:1788330250.506171:0:16637:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:1.0:1788330250.506182:0:16637:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788330249 -> 1788330250 00002000:00010000:1.0:1788330250.506184:0:16637:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788330249 -> 1788330250 00002000:00010000:1.0:1788330250.506186:0:16637:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:1.0:1788330250.506202:0:16637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506218:0:16637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506227:0:16637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506254:0:16637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508c00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:1.0:1788330250.506259:0:16637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506269:0:16637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506298:0:16637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506307:0:16637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000637dcc99/0x91094de4de9abe8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788330250.506408:0:16637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eed7a854-26b2-4d69-8483-63731ccbe763+23:2348:x1875199729464704:12345-192.168.202.47@tcp:4:dd.0 Request processed in 134785us (143831us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788330250.506420:0:16637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 1 00000100:00100000:1.0:1788330250.506457:0:16637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 4 00000100:00100000:1.0:1788330250.506470:0:16637:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eed7a854-26b2-4d69-8483-63731ccbe763+22:2349:x1875199729465088:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:1.0:1788330250.506507:0:16637:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506558:0:16637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330250.506563:0:16637:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788330250.506570:0:16637:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788330250.506604:0:16637:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509744:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509764:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509772:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509779:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface000 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330250.509784:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509792:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509829:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.509837:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a90df0a1/0x91094de4de9abe94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.509925:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eed7a854-26b2-4d69-8483-63731ccbe763+21:2348:x1875199729464832:12345-192.168.202.47@tcp:4:dd.0 Request processed in 134304us (145742us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788330250.509936:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 2 00000100:00100000:0.0:1788330250.509970:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 5 00000100:00100000:0.0:1788330250.509982:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eed7a854-26b2-4d69-8483-63731ccbe763+20:2348:x1875199729465344:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:0.0:1788330250.510016:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.510028:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330250.510033:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788330250.510038:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.510050:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510446:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510457:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510465:0:15097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510483:0:15097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546c214fe00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330250.510487:0:15097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510494:0:15097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510509:0:15097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510536:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c22dea4c/0x91094de4de9abe86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.510576:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eed7a854-26b2-4d69-8483-63731ccbe763+20:2349:x1875199729464576:12345-192.168.202.47@tcp:4:dd.0 Request processed in 149363us (149551us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788330250.510595:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 0 00000100:00100000:3.0:1788330250.510615:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 6 00000100:00100000:3.0:1788330250.510624:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:2348:x1875199729465472:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:3.0:1788330250.510641:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510650:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.510653:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.510657:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.510680:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788330250.511090:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788330250.511105:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000001:00080000:1.0:1788330250.562733:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788330250.563499:0:16639:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:3.0:1788330250.563507:0:16639:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788330250.563539:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563554:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563562:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563568:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a508200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:3.0:1788330250.563573:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563592:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563618:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563625:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dac0ec2/0x91094de4de9abe9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788330250.563720:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eed7a854-26b2-4d69-8483-63731ccbe763+18:2348:x1875199729464960:12345-192.168.202.47@tcp:4:dd.0 Request processed in 179649us (191340us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788330250.563729:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 3 00000100:00100000:3.0:1788330250.563759:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 7 00000100:00100000:3.0:1788330250.563801:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546bfd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eed7a854-26b2-4d69-8483-63731ccbe763+17:2348:x1875199729465600:12345-192.168.202.47@tcp:4:dd.0 00010000:00010000:3.0:1788330250.563831:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563842:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.563847:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788330250.563853:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788330250.563864:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788330250.600612:0:15097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1788330250.600621:0:15097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:0.0:1788330250.600637:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600662:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600671:0:15097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600677:0:15097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509400 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330250.600683:0:15097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600692:0:15097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600713:0:15097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600720:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078a16b36/0x91094de4de9abeb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.600807:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:eed7a854-26b2-4d69-8483-63731ccbe763+19:2348:x1875199729465472:12345-192.168.202.47@tcp:4:dd.0 Request processed in 90180us (224478us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788330250.600817:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 6 00010000:00010000:0.0:1788330250.600860:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600878:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600884:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600890:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546bface600 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330250.600893:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600901:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600911:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.600918:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305b411d/0x91094de4de9abea9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.600946:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:eed7a854-26b2-4d69-8483-63731ccbe763+17:2348:x1875199729465344:12345-192.168.202.47@tcp:4:dd.0 Request processed in 90968us (226237us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788330250.600953:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 5 00000001:00080000:0.0:1788330250.603674:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00010000:00010000:0.0:1788330250.603770:0:16637:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.603809:0:16637:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.603818:0:16637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.603824:0:16637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9546a2719a00 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330250.603828:0:16637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.603836:0:16637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.603859:0:16637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.603866:0:16637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002072842c/0x91094de4de9abea2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16637 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.603947:0:16637:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:eed7a854-26b2-4d69-8483-63731ccbe763+9:2349:x1875199729465088:12345-192.168.202.47@tcp:4:dd.0 Request processed in 97477us (231534us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788330250.603956:0:16637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 4 00000001:00080000:2.0:1788330250.633075:0:6702:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:0.0:1788330250.633367:0:16639:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788330250.633386:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.633415:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.633425:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.633432:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95468a509200 already unused, calling callback (ffffffffc172b230) 00010000:00010000:0.0:1788330250.633438:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.633447:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.633467:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788330250.633475:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955aa8e1/0x91094de4de9abeb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788330250.633672:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546bfd3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:eed7a854-26b2-4d69-8483-63731ccbe763+5:2348:x1875199729465600:12345-192.168.202.47@tcp:4:dd.0 Request processed in 69900us (257302us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788330250.633682:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 7 00010000:00010000:1.0:1788330251.295969:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788330252.166154:0:16677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1788330252.320399:0:14399:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788330252.614762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.614816:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.614873:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.614911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.614948:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.614969:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.614992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.47@tcp (source: 12345-192.168.202.47@tcp) 00000100:00100000:0.0:1788330252.615025:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729466112 00000100:00100000:0.0:1788330252.615036:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729466112 00000100:00100000:0.0:1788330252.615093:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729466368 00000100:00100000:0.0:1788330252.615104:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729466368 00000100:00100000:0.0:1788330252.615135:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465984 00000100:00100000:0.0:1788330252.615138:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465984 00000100:00100000:0.0:1788330252.615151:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729466496 00000100:00100000:0.0:1788330252.615154:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729466496 00000100:00100000:0.0:1788330252.615172:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 15 00000100:00100000:0.0:1788330252.615183:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eed7a854-26b2-4d69-8483-63731ccbe763+5:2347:x1875199729466112:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.615604:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788330252.615617:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2347:x1875199729466368:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.615686:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2347:x1875199729466368:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 70us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.615694:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 16 00000100:00100000:3.0:1788330252.615720:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:3.0:1788330252.615727:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2347:x1875199729465984:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.615775:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eed7a854-26b2-4d69-8483-63731ccbe763+5:2347:x1875199729465984:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 49us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.615781:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 17 00000100:00100000:3.0:1788330252.615794:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:3.0:1788330252.615799:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2347:x1875199729466496:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.615822:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+5:2347:x1875199729466496:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 23us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.615828:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 18 00000100:00100000:3.0:1788330252.615854:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465728 00000100:00100000:3.0:1788330252.615859:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465728 00000100:00100000:3.0:1788330252.615893:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 121 00000100:00100000:3.0:1788330252.615900:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95469da73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:2347:x1875199729465728:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.615925:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95469da73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e979e524-ede4-47ab-a6d6-7286fd1739fb+13:2347:x1875199729465728:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 27us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.615931:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 121 00000100:00100000:3.0:1788330252.615966:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729465856 00000100:00100000:3.0:1788330252.615970:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729465856 00000100:00100000:3.0:1788330252.616000:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875199729466240 00000100:00100000:3.0:1788330252.616002:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875199729466240 00000100:00100000:3.0:1788330252.616022:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330252.616027:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+20:2347:x1875199729465856:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.616063:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eed7a854-26b2-4d69-8483-63731ccbe763+20:2347:x1875199729465856:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 35us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.616070:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 28 00000100:00100000:3.0:1788330252.616083:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00100000:3.0:1788330252.616097:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9546a12f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2347:x1875199729466240:12345-192.168.202.47@tcp:400:kworker.0 00000100:00100000:3.0:1788330252.616140:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:53125d11-03c0-4823-81ae-5aa109fa0df8+6:2347:x1875199729466240:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 45us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788330252.616146:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 29 00000100:00080000:3.0:1788330252.616166:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788330252.616171:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788330252.616172:0:14406:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788330252.617107:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9546a12f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:eed7a854-26b2-4d69-8483-63731ccbe763+5:2347:x1875199729466112:12345-192.168.202.47@tcp:400:kworker.0 Request processed in 1914us (2279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788330252.617133:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.47@tcp, seq: 15 00010000:00010000:1.0:1788330253.356068:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29553 lines, 29553 kept, 0 dropped, 0 bad.